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ABSTRACT 

This report summarizes the techniques used iu 
gathering and maintaining a data file on most of the Army aviator 
trainees who have been through the Officer/Warrant Officer Rotary 
Wing Aviator Course and the Warrant Officer Candidate Course during 
the period 1 July 1968-31 December 19 69. Specific regression analyses 
dealing with the prediction of student performance in training are 
furnished, and the methods used to obtain them are described. The 
equations allow the extrapolation of current training performance to 
a prediction of (1) the probability that the individual will pass the 
course, and (2) what his final end-of -course grade will be. A review 
of the most pertinent literature in the area is included as are 
frequency counts of a large volume of training data. (Author) 
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This report summarizes the techniques used in gathering and maintaining 
a data file on most of the Army aviator trainees who have been through the 
Officer/Warrant Officer Rotary Wing Aviator Course 2C-1981-B/2C-062B-B and 
the Warrant Officer Candidate Course 2C-0O2B-C during the period 1 July 
1968-31 December 1969. Specific regression analyses dealing with the 
prediction of student performance in training arc furnished, and the 
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methods u.^cd to obtain them arc described. TIio equations allow the 
extrapolation of current training performance fo a prediction of 
a) the probability that the individual will pass the course, and 
W what his imal end-of-course grade will be. A review of the most 
pertinent literature in the area is included a. are frequency counts 
of a large volume of training data. 
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MILITARY PROBLEM 

Flight training is one of the Army's most costly training programs, so the manage- 
ment of- manpower and training resources is especially critical in aviation. An important 
aspect of this management concerns the handling of attrition during flight training. When 
an aviation trainee falters, and is nominated for possible expulsion from the program, the 
Army must decide whether further investment of training in this individual is warranted, 
considering his past performance, or whether he should be eliminated from the program, 
thereby avoiding any further expense in what may be an unsuccessful training investment. 

In making this decision, the responsible military personnel, in the form of a Faculty 
Board, are required to evaluate a large quantity of information. This information comes 
to the Board in the student's grade folder, which contains standardized test information, 
demographic information, and all of the grades which the student has received in training 
up to the point of his nomination for possible expulsion. Reduced onto the PREDICT 
data file, this information contained over 100 separate data entries. 

Understandably, it is difficult for the military decision maker, acting on his 
judgment alone, to use this large mass of information with maximum efficiency. Work 
Unit PREDICT was aimed at summarizing this information, through multiple regression 
techniques, in a manner to aid this decision process. 



RESEARCH PROBLEM 

The research goal of this effort was to produce a set of mathematical relationships 
based on multiple regression analyses, which could be used to extrapolate an individual's 
present and past performance into a prediction of his future performance in training. In 
doing this, standardized test information and demographic information were used in 
addition to training performance records. 



METHOD 

The collection and organization of data present major problems in an effort of this 
type. The exact number of data entries gathered varies from individual to individual. 
Some people received more graded flights than others; some information is not available 
on all people. However, it can safely be said that more than 100 separate data entries 
were gathered on most of the individuals considered in these analyses. These data 
included standardized test information where it was available, and demographic 
information such as marital status and number of children. 

Standard multiple regression techniques were used to reduce this information to 
predictive equations for each of seven different points in time during the primary 
helicopter training program. These seven time periods were not evenly spaced throughout 
the training program. Rather, they represented the times which the Student Evaluation 
Review Council at Fort Wolters had indicated would be the most valuable for their 
utilization of the information.^ Actually, the last of the seven equations is appropriate 

'The bulk of this research was conducted during the period when the Primary Phase of the Initial 
Entry Rotary Wing (lERW) training was conducted by the U.S. Army Primary Helicopter School at Fort 
Wolters, Texas. As of 30 July 1973, that training was moved to Fort Rucker, Alabama, where it is 
conducted, along with the remainder of lERW training, by the U.S. Army Aviation School. 
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for a time approximately one-halE of the way through the primary fUght program. For 
the classes used in this research, almost all of the attrition had occurred by this point in 

the program. ., 
Two criteria or dependent variables were examined. One of these was the pass/taii^ 
dichotomy. Since whether or not a man ultimately passes training or fails is the crux of- 
the matter, the pass/fail issue was thought to be a suitable criterion. Later examination 
showed that, while it had value, there were certain problems associated with using 
pass/fail as a criterion. Therefore, a second criterion, final end-of-course grade or class 
standing, was also examined. Predictive equations were calculated for each of seven time 
periods during the Primary Helicopter training for each criterion. 



RESULTS 



The primary results of this effort are equations for predicting the performance of 
students in the Primary Phase of Army Initial Entry Rotary Wing flight training. The 
summarizing of these equations is best left to the main text of the report. However, a 
brief description of differences between the passing student and the failing stutlent, and 
also the differences between the high-scoring and the low-scoring student, might be useful 
here. Separate descriptions are given for officer students and Warrant Officer Candidate 

students. , i i • i 

A verbal picture of the successful Warrant Officer Candidate (WOC) would include 
the fact that he has a slightly higher ranlc upon entry into the program than his peers, 
indicating that he was more lilcely to have been obtained from in-service sources. 
CoiTespondingly, he is slightly older than his peers. The more time he has m the service, 
the higher is his probability of successful training completion. On the otfffer hand, his 
end-of-course standmg is lilcely to be somewhat lower with more time in service. The 
successful Warrant Officer Candidate is better educated than his peers, and he is more 
likely to have had some flight traming prior to entering the Army flight training program 
His Flight Aptitude Selection Test (FAST) score is higher, while his General 
Technical (GT) score is of no consequence in determining whether he will pass or tail the 
course If he is married and has children, his probabihty of passing is greater, but this 
factor has little effect on his final end-of-course grade. The successful aviation Warrant 
Officer Candidate scored well on the Armed Forces Qualification Test (AFQ 1 )■ by 
definition, he does well on his Airmanship Examinations, his Warrant Officer 
Developm.ent Examinations, and his flight grades. 

The officer aviator trainee who scores well in his end-of-course standings is also^a 
little older than his oeers. However, he generally has not been in the service as long as his 
contemporaries. He is somewhat above average in education, and he has had some 
previous flight training. He tends to score better if he is married and has children. 



CONCLUSIONS 



Statistically significant multiple correlations were obtained ranging from R - .23 to 
R= 80 As expected, the value of R increased over time as new predictors were added, 
but 'little increase in predictive efficiency ' resulted from the use of more than live 
predictor variables. Results were stable on cross vahdation. 
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In short, the predictive equations furnished in the text of this study can be used to 
summarize effectively for prediction purposes the information available on each trainee at 
each of seven points during the training program. These equations furnish an 
extrapolation of this available information in order to provide a predicted pass/fail 
probability and a predicted end-of-course grade for each individual. Further, the predicted 
end-of-course grade can be translated into a predicted end-of-course percentile 
class standing. 

In addition to their use in faculty board decisions, these extrapolations of student 
performajice could also be used in a student counselUng program. The Training 
Advisor/Counselor (TAG) officer, or some other designated individual, could be provided 
a periodic posting of his students that not only would include a predicted probability of 
eventual success, and a predicted end-of-course grade, but also would provide the 
counsellor with some idea of the nature of the individual student's problem. 
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PREFACE 



Work Unit PRKDICT was' initiated to clovolop a (lain sysioni which could l)e used by 
the Army to make in-trainini^ predictions of ultimate trainini^ success for individuals in 
the Initial Entry Rotary Winj; Flight training prop;Tam. This information was to be used to 
assist the U.S. Army Primary Ik^licopter School in makmj:^ administrative decisions 
concerning the disposition ot* students who encounlered flight, academic, or other 
difficulties. It v/as also anticipated that the data pool recjuired for tlie prediction of 
student training performance woukl potentially l)e useful in the prediction of other 
training and post-training job performance criteria. 

When the research was conceived and begun, Army primaiy helicopter training was 
given by the U.S. Army Primaiy Helicopter School, Fort Wolters, Texas. Students then 
went to the U.S. Army Aviation • School at Fort Rucker, Alabama, for their advanced 
helicopter training. The I^REDICT research was designed and data were gathered under 
this administrative organization. However, a major change occuiTed in FY 1974 when 
Fort Wolters was closed and primary training was moved to the U.S. Aniiy Aviation 
School at Fort Rucker. This change and many others associated with it adversely affected 
the conduct of the PREDICT research and its utility as an operational system. 

After the prediction equations were developed, experimental operation of the 
PREDICT system was begun at Fort Wolters. The closing of Fort Wolters occurred before 
the utilization of the system reached the desired level of effectiveness. After the move of 
primary training to Fort Rucker, attempts were made to utilize the system at the U.S. 
Army Aviation School. However, because of the various changes in the syllabus of 
instruction and administrative organization, those attempts were not particularly 
successful, although the predictive equations functioned as expected. The present report 
documents the methodology employed and can serve as a basis for future training 
management systems that are based on multiple prediclor systems. 

The research was conducted at HumRRO Central Division, Dothaii Office (fomierly 
Division No. 6). Dr. Wallace W. Prophet is Director of the HumRRO Central Division and 
Dr. Paul Caro is Dothan Office Director. The project was initiated, and the first 
regressions were obtained, under the leadership of Dr. Wiley II. Boyles. The second study, 
its cross validation, and the writing of this report were conducted under tlie leadership of 
Dr. James W. Dees. Other HumRRO personnel who have participated in the project are 
L. Paul Dufilho, H. Alton Royd, James L. Wahlberg, and Peter R. Prunkl. 

Military support was i)rovided by the U.S. Army Research Institute Human Research 
Unit, Fort Rucker, Alal^ama. LTC Donald E. Youngpeter is the Chief of the Human 
Research Unit. During the conduct of the PREDICT work the Human Research Unit 
provided a total of four officers in support of the project: CPT Lmy C. M^urrs, 
CPT Robert N. Seigle, CPT Richard L. Campbell, and CW-3 Charles L. Phillips. Enlisted 
support was provided by a total of 26 enlisted personnel: 

SP5 Josc^ph J, Baldwin SP5 Gary L. Ridgway 

'^'^5 Alan Boo'ger SP5 Gary W. Seals 

SP5 Calvin L. Branch SP5 William R. Soldressen 

SP5 Flal W. Howington SP5 John M. Stahura 

SP5 Paul A. Kazmierczak SP5 Robert A. Tangney, Jr. 

SP5 James II. McGinnis SP5 Peter C. Tomolonis 

SP5 David McT ae SP5 Eric Wiigner 



ERIC 



SP5 James L. Wahlberg SP4 Daniel A. Polovina 

SP5 Curtis W. Waller PV2 Teriy V. Bishop 

SP5 Merlin V. Widup PV2 Kenneth J. Bouma 

SP4 Gary D. Dotson PV2 Timothy Putka 

SP4 Kenneth P. Odom PFC Richard A. Uhlar 

SP4 Richard L. Oltmann PVT John M. Trezise, Jr. 

The military support strength at peak loading was about one officer and seven enlisted 

personnel. 

HumRRO research for the Department of the Army under Work Unit PREDICT was 
conducted under Army Contract DAHC19-73-C-0004. Training research is conducted 
under Army PrOjeit 2Q162106A723. The PREDICT work was conducted under the 
sponsorship of the U.S. Army Research Institute for the Behavioral and Social Sciences 
with Dr. David Meisfcer serving as the technict\l monitor. 



Meredith P. Crawford 
President 

Human Resources Research Organization 
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INTRODUCTION 



BACKGROUND 

The motivating stimulus for Work Unit PREDICT has been the Army's continuing 
concern with attrition in the aviation training progi-am. As far back as 1963, the U.S. 
Army Aviation School, Fort Ruckor, Alabama, requested specific assistance from 
. HumRRO, in the form of Technical Advisory Service, concerning attrition rates in the 
aviation program. This concern with training attrition has been the stimulus for a large 
variety of different research progi-ams. Under Work Unit ECHO, for example, it was 
determined that experience in certain types of simulators or training devices reduced 
attrition in the flight training program.' 

It is likely that every major militai-y flight training program has i}een concerned with 
the attrition problem. While the percentage of students who attrite in undergraduate pilot 
training (UPT) programs (i.e.,, the 'Svashout rate") varies from one time to another and 
from one sendee or situation to another as a function of mmy complex factors, typically 
attrition rates of one student in five, or one in three, are cited as being likely. While this 
problem has ahvays been of prime concern to the services, from the standpoint of 
training efficiency, the recent fuel crisis has added a dimension over and above that of 
cost effectiveness. The manpower and resource management aspects of flight trainee 
attrition will continue to be of concern. 

Efforts to maJiage the attrition problem more effectively fall into three general 
categories: (a) efforts related to pretraining selection of trainees (primary selection); 

(b) efforts related to improved training methods designed to reduce attrition; and 

(c) efforts aimed at maximizing the likelihood, after training is started, that those trainees 
with high training success probabilities are retained in the progi*am and those with 
imacceptable success probabilities are eliminated with the minimum investment of 
training resources (secondary selection). The PREDICT research effort falls into this 
third, or secondary selection, category. 

In FY 1965, HumRRO initiated a study (Exploratory Research 38) dealing with the 
training, utilization, and retention of Wairant Officer aviators. This project developed a 
number of questionnaire items that showed some validity for predicting the retention of 
Warrant Officer aviators in the service.' The predictions of retention obtained in ER-38 
stimulated an interest in the possible use of a similar approach to predict attrition in the 
aviation training program. It was reasoned that if a questionnaire could predict with fair 
accuracy whether or not a man would elect to remtiin in the service, a more 
comprehensive data pool should have considerably more predictive potential. This data 
pool would contain demographic information, standardized test scores, and available 
training data on each individual. The potential of such an approach was emphasized by 
the success of a similar approach for the Nav^^'s aviation training program. -"^ 

^Paul W. Caro, Jr., Roborl N. islcy, and Oran B. Jolloy. The Captive Helicopler as a Training 
Device: Experimenlal Evaiaaiion of a Concept, HumRRO Tochnicat Report 68-9, June 1968. 

^H, Alton Boyd, and Wiley R. Boyles. AlUliidcs as Predictors of Retention for Army Pilots, 
HumRRO Professional Paper l.|-(i9, May 1969. AD-688 816 

'"^Richard F. Booth, George M. Rickus, Jr., and ]U)salie K. Ambler. Predicting tfie Career Naval 
Flight Officer, NAiMMOTO, Naval Aerns;paro iVledical Instil uto. Naval Aerospace Medical Center. Pensa- 
^ cola, Florida, May 1969. AD-69^J 896 
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A feasibility study of this multivariate approach was approved during the third 
quarter of FY 1968, under the designation of Exploratory Research 70. ER-70, which 
was completed in FY 1969, was the direct precursor of Work Unit PREDICT. It also 
produced the background Activities Inventory (BAI).^ This Inventory, further discussed 
by Prophet,^ was a questionnaire containing items concerning the willingness of the 
individual to expose himself to the threat of physical harm. One conceni in ER-70 was 
the utility of the BAI and similar instruments for predicting performance under stress as 
in pilot training or combat. The initial data looked promising, and the BAI was examined 
further under Work Unit PREDICT. In 1968, a plan to develop computerized multiple 
correlation predictor systems for use in the Army's aviation program was discussed.^ 

Work Unit PREDICT^ began formally in the fourth quarter of FY 1969. The first 
two years of the progi-am were spent in developing the system and gathering the data.^ 
Since it took 40 weeks at that time for a man to go through the aviation training 
program, and since at least a six-month quota of students was required for statistical 
analyses, no analyses could be initiated until the beginning of the second quarter of 
FY 1970. In the interim, a number of small studies were conducted to explore the 
potential of many variables as predictors. Some of these studies are referred to in the 
next section. 



EXPLORATION OF POTENTIAL PREDICTORS 
Preliminary Research 

The possibility of birth order as a predictor variable was explored, but no significant 
differences were found. 

The potential of a peer rating was examined.'' The validity coefficients obtained 
indicated that the peer rating then in use in primary helicopter flight training would 
probably be an excellent predictor in the multivariate system. Unfortunately, the peer 
rating was changed", and became considerably less reliable. Therefore, it was not included 
in the predictive equations. 



* Wiley R. Boyles. Measures of Reaction to' Tlireat of Physical Pfarm as Predictors of Performance 
in Military Aviation Training, HumRRO Prores^ioni^l Paper ir^-69, May 1969. AD-688 817 

Wallace W. Prophet. Human Factors in Aviation: Some Recurrent Problems and New Approaches, 
HumRRO Professional Paper 30-67, June 1967. AD-656 971 

Wallace W. Prophet. Prediction of Aviator Performance, HumRRO Professional Paper 5-69, 
February 1969. 

"^AU of the data reported in this document were gathered at the U.S. Army Primary Helicopter 
School (USAPHS) at Fort Wolters, Texas. On 30 July 1973, the USAPHS began closing and primary 
training was initiated at the U.S. Army Aviation School (USAAVNS), Fort Rucker, Alabama, with 
consequent changes in the syllabus and terminology. For example, the functions of the Student 
Evaluation Review Counsel (SERC) at Fort Wolters have been assumed by the Faculty Board at Fort 
Rucker. It should be kept in mind that the PREDICT research was ba.sed on data gathered during the 
time when USAPHS was in operation and is, therefore, tailored to the program and management 
structure that existed at that timo. While many changes have resulted from the transfer of primary 
training, the general problems of trainee attrition and its relationship to trainee aptitudes, psychological 
and sociological factors, and performance probably are similar in the new training setting. 

^ See Appendix E for the original PREDICT technical plan developed during this period. This plan 
describes the general rationale and the detailed data collection procedures used. 

Peter R. Prunkl. Factors in Predicting Army Aviator Performance: Birth Order and Participation 
in Dangerous Sports and Activities, HumRRO Professional Paper 13-69, iNlay 1969. AD-688 812 

' J. L. Wahlberg, Wiley R. Boyles and H. Alton Boyd. Peer Ra lings as Predictors of Success m 
Military Aviation, HumRRO Professional Paper 1-71, March 1971. AD^72 1 695 
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The Flight ApUlutU^ Selection Test (FAST), while developed by Kaplan' as a 
primary selection instrument, was determined also to be a strong predictor of flight 
deficiency eliminations among students already in the program.^ There are two separate 
FAST tests, one for the selection of Warrant Officer Candidate (WOC) students, and one 
for the selection of officer students. 

Literature Review 

The training literature was surveyed in order to identify types of variables that had 
been successful in previous attempts to predict trainee performance. Two studies 
published by the Naval Aerospace Research Laboratory demonstrated a correlation 
between procurement source cind amount and typo of attrition in Naval aviation 
training.^ Wherry and Hutchins found that the use of procurement source in 
dichotomized form in the ccTmputation of the multiple prediction formulae resulted in 
increases in the formulae'^ validity for both officers and non-officers. Wherry also 
developed a procedure, known as the pseudovariable technique, for handling nominal data 
that might occur in classification (e.g., procurement source) in the niultiple regression 
analyses."* • 

A number of prior studies have shown correlations between rank and age upon entry 
into flying training progi'ams, and performa^ice in those progi'ams.^ In the Kaplan 
study, which established the FAST battery for primary selection (i.e., selection of 
candidates for the aviation progi'am), rank and age were negatively related to flight 
grades, but positively related to leadership evaluations. In that study, it was concluded 
that this variable would be ineffective for selection because of the reversal across flight 
grades and leadership evaluations. In general, the lower ranking and younger students 
tend to be better pilots while the higher ranking and older students tend to be better 
leaders. Kaplan argued that since the Army wishes to train people who will be both good 
leaders and good flyers, a restrictive policy on rank would lead to an increase on one 
performance measure but a decrease on another. Of course, lower ranking, younger 
officers become higher ranking, older officers. It would appear, therefore, that a good 
case could be made for restricting the upper age group. 



Harry Kc\p\c\n. Prediction of Success in Army Aviation Training, Technical Research Report 1 T42, 
U.S. Army Personnel Research Office, Washingt.on, June 1905. 

2 

Wiley R. Boyles, and James L. Wahlberg. Prediction of Army Aviator Performance:' Description 
of a Developing' x^ystem, HumRRO Professional Paper 5-71, April 1971. AD-72 1 696. 

^ R. J. Wherry, Jr., niid C. VV. Hutchins, Jr. 'An Investigation of Unprcdicted Differences in 
Attrition^ Rates Among Students From Different Procurement Sources, U.S. Naval School of AviaUon 
Medicine Report USAM-907, Pensacola, Florida, October 1964, 

R, J. Whefry, Jr., and 0. W. Hutch ins, Jr. 77; i? I'so of Procurement Source as a Predictor of 
Success in Training, Special Report (55-5, V.S. Naval School of Aviation Medicine, Pensacola, Florida, 
July r965. . * 

^ R. ' A. Bottenberp and R.E. Christai. An Interactive Tcciinique for Clustering Criteria Which 
Retains Optimum Predictive PJfficIcncy, VVADD-TN-61 -30, Personnel Laboratory, Lackland AFB, 
Texas, 1961. 

R. J. Wherry, Jr. Toward an Optimum Method of Equating Subgroups Composed of Different 
Subjects, Monograph 9, U.S. Naval School of Aviation Medicine, USAM Medical Center, Pensacola, 
Florida, August 1964. 

^ C. W. Hutchins, Jr, Relationship Bctioccn the Uanh of hwoming Officers and Success in Flight 
Training, Report 911, I'.S. Navni School of Aviation Medieine, P-nsacola, Florida, November.1964. 
Kaplan, op. cit. 
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In another investigation of the rank/age factor, liLitchins found that rank was a valid 
predictor variable for success in Naval aviation training.' In addition, he found that the 
higher ranking officers attrited more often by means of the DOR (Dropped on Request) 
category than did the lower ranldng officers. In" the Army situation, self-initiated 
elimination (SIE), which is comparable to the Navy's DOR category, has, at various 
points in time, been one of the major attrition problem areas. 

In his 1965 study, Kaplan found that the preserce or absence of previous flight 
training y^as related to the probability of an indi\adu^il's passing the flight training course. 
In the same study he found low correlations between educational level and the various 
training performance criteria within the training program. In general, the correlations 
were positive with academic performance, and negative with flight and leadersliip 
performances. 

Cognitive tests were found to be stxong predictors of academic performance in the 
Warrant Officer Candidate helicopter training progi-am.^ Of those investigated by Kaplan, 
the General Technical (GT) score, which is a component of the Army Classification 
Battery (ACB) taken by all enlisted men at the time of their induction into the Army, 
had the highest single correlation with academic performance of all of the measures 
investigated in the FAST validation study. This score is derived from arithmetic reasoning 
and verbal scores of the ACB. 

Academic courses in wliich success has been shovm to be related to the probability 
of completion of the Navy flight training course were mathematics, physics, navigation, 
engineering, aerodynamics, and physiology.^ The Army aviation academic examination 
program is not divided in terms of classic technical or academic subject matter areas, but 
some of the subject matter is identifiable at various points in the Airmanship (AME), 
Warrant Officer Development (WDE), and Rotai-y Wing Course (RWC) Examination 
series."* Table 1 provides examples of similai'ities between the Army and Na\^ academic 
programs. Also included are the point biserial con:elations of the Navy test scores in these 
content areas with the complete/attrite criterion in the Navy program. These correlations 
can be found in the Shoenberger, Wherry, and Berkshire publication. In view of this, it 
was felt that the Army academic examination scores would be worthy of investigation as 
potential predictor variables. 

Also, Shoenberger et al. determiiied that in the Navy, once flight grades are 
available, they become the strongest single predictor of future performance for 
non-officers and officers through the remainder of the training program. While the 
average grade for the previous phase of fliglit is the strongest predictor in each case, the 
flight grades for non-officers from the pre-solo period are significant contributors to 
prediction for every subsequent phase of tlie program. 

Lane and Peterson^ found that an individual's college major correlates well with 
success in the Navy aviation training program. Generally, individuals with engineering 



Hutchins, op. cit. 
Kaplan, op. cit. 

^R. W. Shoenberger, R. J. Wherry, Jr., and J. R. Berkshire. Prcdicling Success; in Aviation 
Training, Research Report Number?, U.S. Naval School of Aviation Medicine, Pcnsacohi, Florida, 
September 1963. 

^The reader .should keep in nriind that .some of this lornihiolotry and course organization may have 
changed as a result of the move from USAPHS to USAAVNS. 

^Norman E. Lane and Floyd E. Petcr.son. Coicgc Major Differences in Naval Flighl Officer 
Training Performance, Special Report 66-7, U.S. Naval Aero.<;pacp Medical Jn.stitute, U.S. Naval Aviation 
Medical Center, Pensaoola, Florida, November 1966. 
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Table 1 

Comparison of Army and Navy Academic Content Areas 



Army Examinations^ 


Navy Content Area 


Navy Point-Biserial 
Correlations With 
Complcte/AttritG 


AME 1 


Aerodynamics 


Non-officers 


144 






Officers 


151 


AME 2 and 3 


Engineering 


Non-officers 


124 






Officers 


168 


AME 4, 5, 6, 1, 


Physics 


Non-officers 


105 


12, and 15 




Officers 




AME 16, 17 


Math 


Non-officers 


150 






Officers 


122 


AME 11, 13, and 14 


Navigation 


Non-officers 


.162 


WDE 7 and 8; 




Officers 


.147 



RWC1,RWC2 

'''AME, Airmanship; WDE, Warrant Officer Development; RWC, Rotary 
Wincj Course. 

backgrounds performed better than those with nontechnical backgrounds. Physical 
education majors performed significantly worse than the other majors. In another study, 
Rimland' determined that skill in sports bears no relationship, positive or negative, to 
officer performance and career motivation. 



' Bernard Rimlancl. The Relationship of Athletic Ahiiity, Sports Knowledge and Physical 
Proficiency to Officer Performance and Career Motivation, Technical BullcUn 61-12, Bureau of Naval 
Personnel, Washington, August 1961. 
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METHOD 



SUBJECTS 

The data bank used in this research included entries on virtually all trainees in the 
Warrant Officer Rotary Wing Aviator Course (WORWAC) Classes 69-05 through 70-49 
and the Officer Rotary Wing Aviator Coiurse (ORWAC)^ Classes 69-06 through 70-50. 
The exception is a gap of approximately six months occurring the last half of FY 1969; 
specifically, WORWAC Classes 69-31 througli 69-49, and ORWAC Classes 69-32 through 
69-50 are missing. 

The chronological class designations are based on the time of entry of a class. Forty 
weeks were required for the training program in 1969. In addition, six months of data 
were needed to obtain an adequate sample. Thus, even though the first class of the first 
sample began the program in September 1968, the data of the last class in that six-month 
sample were not available for analysis until December 1969. 

These data were divided into three samples. The FY69 sample included Classes 

69- 05 through 69-29 for WORWACs. The ORWAC data for Classes 69-06 through 69-30 
were not analyzed. Six months after completion of the FY69 data, additional data were 
gathered for cross-validation purposes. This FY70 sample included WORWAC Classes 

70- 01 through 70-23, and ORWAC Classes 70-02 through 70-2Jt,-fae remaining 4^^^^^^^ 
gathered as insurance in case a third analysis was needed, but the third analysis was not 
necessary. 

Summaries of the demographic data and the collapsed variables used in the analyses 
are given in Appendices A-D. A brief description of a few of the demographic 
characteristics of the warrant officer and officer students is given here so the reader will 
have an idea of the general characteristics of the student samples. 

Warrant Officers . The FY69 Warrant Officer sample^ contained 2,799 Warrant 
Officer Candidates (WOCs). The FY70 sample contained 1,826 WOC students. Based 
upon the 1969 sample, the ages of the entering Warrant Officer Candidate (WOC) ranged 
from 18 to 34 years, with a mean of 20.9.^ a median of 20, and a mode of 19. The mean 
education of the WOC was 12,9 years, the median was very close at 13 years of 
education, while the mode ;A'as 12 years. The mean for months of prior service was 13.7, 
while the median and mode were both two months, Thus,^the majority of the Warrant 
Officer Candidates in the 1969 sample had been in the service only a short period of 
time. The mean FAST score was 310.4 with a median of 307. The mean AFQT was 83.4 
with a median of 87. Roughly 30% of the WOCs were currently married, 2% were 
divorced, and 68% were single. Approximately 74% of the WOCs were obtained through 
the enlistment option program,^ while 26% were obtained from in-service sources. 

*The WORWAC and ORWAC courses are often ret'errcd to collectively as the Initial Entry Rotary 
Wing Course (lERW). 

Warrant Officer Candidate classes received odd number designations (e.g., 69-05, 69-07). and 
officer class designations were even numbers (e.g., 69-06, 69-08). 

"^The enlistment option program allowed an individual volunteering for the service to select the 
type of job in which he would serve, provided he could qualify. The Aviation Warrant Officer Program 
was a popular choice. Those individuals entering the aviation program in this manner received their basic 
combat training at Fort Polk, Louisiana, and then went immediately to Fort Welters for flight trailing. 
A high school diploma was required. 
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Officers . The olTiccr data were analyzed only on tne FY70 sample, which consisted 
of Classes 70-02 through 70-24. and included a total o^' 1,206 officers. Based upon the 
1970 sample, the age of the officers in the aviation progi'am ranged from 19 years to 45 
yeai-s, with a mean of 24.6, a median of 23, and a mode of 23. The'7)fficers had a mean 
of 14.5 years of education, a median of 15 years, and a mode of 16 years. The range of 
education was from 9 to 20 years. The mean for months of prior service was 29.9, the 
median was 19, and the mode was 52. The range of months of prior service was Irom 
zero to more than 143 months. Sixty-seven percent of the officers were currently 
mamed. Thirty-two percent were single, and less than one percent were divorced. 
(Further details on these demogi-aph=c variables and :ill of the variables used in the 
PREDICT system for l^oth officers and warrant officers are available in Appendices A-C). 



DATA COLLECTION 

All the results reported in this study were derived from data obtained from the U.S. 
Army Primary Helicopter School (USAPHS) at Fort Wohers, Texas. 

In the eariy stages of the reseai'ch effort, a system for the transfer of biographical 
and training information from Fort Wolters to HumRRO was established. These data 
were forwarded on printed reports and standardized forms which were then in use at 
USAPHS. The documents were: (a) initial data printout (biographical data and class 
assignment information), (b) the block form (standardized test scores), (c) individual 
flight resumes (daily flight grades), and (d) individual academic resumes (results of 
Ainnanship and Warrant Officer Development Examinations). 

As this information was received, the academic grades, biographical data, and class 
assignment information were re-recorded on a form designated as the PREDICT 
Individual Data Record (PIDR). This procedure was necessary in order to consolidate 
information from several sources onto one record for key-punching. A more detailed 
explanation of the original transfer of data is reported in Section 3 of the original 
PREDICT planning paper reproduced as Appendix E of this report. 

This system for data collection and recording was in effect through all of the FY69 
classes and was continued with FY70 Classes 70-01 through 70-26. Beginning .with Class 
70-27, the transfer of data became fully automated— the Management Information 
Systems Office (MISO) at Fort Wolters began "to ship the 80-column IBM cards created at 
the Fort Wolters Electronic Data Processing Center directly to the PIumRRO Computer 
Center. These cards contained the same type of information which had previously been 
received on the printed forms and documents. Under the new sy::tem, the procedure for 
transferring data from the original source document to the PIDR was eliminated. The 
exclusion of this step greatly reduced the processing time for deriving new regression 
equations, but also created a significant time lag in the quality control of the data. 

One of the major areas of concern during the receiving and editing of data was that 
of routine syllabus changes which occurred occasionally in the academic and flight 
portions of training. These changes required constant monitoring, since the data from 
which a set of predictive equations were derived had to be compatible with the data 
generated by the classes being evaluated. 

For the period of time covered by this report, there were two major syllabus 
changes. Tables 2 and 3 note the status of the syllabus which was in effect when the 
project began. Table 2 outlines the 20-week training syllabus for Warrant Officer 
Candidates, and Table 3 outlines the 18-week training syllabus for the officers. (In 
preflight. Warrant Officer Candidates received two additional weeks of training.) It should 
be noted that Table 2 shows AME 18 although this is appropriate only for Classes 70-41 
through 71-22. These proj^^rams wore in effect for Classes 69-01/02 throudi Classes 
Q 71-21/22. 
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Tables 4 and 5 outline for the WOCs and officers, respectively, the first program of 
instruction syllabus change which began with Classes 71-23/24 and continued through 
Classes 71-49/50. Tables 6 and 7 represent the same information for the second syllabus 
change covering the time period beginning with Classes 72-03/04. 

Inspection of these tables, shows that the major syllabus changes included a 
reduction in the number of Airmaiiship Examinations, .Warrant Officer Development 
Examinations, Officer Development Examinations, and the overall time in training. Also, 
it should be noted that the number of questions and the total . contribution of points 
toward the final academic grade were modified considerably in the two syllabus changes. 

SELECTION OF VARIABLES 

A literature review and some small research projects contributed greatly to the 
selection of variables. These efforts were documented in the introduction to this report. 
Generally speaking, there were three primary criteria for the selection of variables for 
inclusion in the PREDICT data bank. First, similar studies, conducted principally by the 
Navy, have revealed a large number of variables which have predictive validity. These 
variables or their analogues were examined for their predictive potential in the Army 
aviation training system. Second, there were a number of potential predictors that seemed 
to have face validity; that is, they logically should have been predictors. Many of these 
were examined. Third, there were a large number of variables which were easily available 
from Army records, but about which no further information was known. A number of 
these were also examined. 

Unfortunately, there were also some variables w^hich were proven to be good 
predictors in the Navy system, but which were unavailable in the Atmy system. For 
example, the Navy uses a peer rating system initially administered prior to the ninth 
week of flight training. In the Navy's ninth and tenth week matrix, this produces a 
complete/attrite correlation of .195 using the point biserial correlation statistic' The 
Army at one time had a peer rating which looked very promising.^ Unfortunately, a 
change in that peer rating made it unusable during the period of this study. 

In the process of selecting variables to be recorded for future analysis, a number of 
small studies were conducted to determine the predictive potential of some of them. 
•Several of these studies were concerned with a Background Activities Inventory (BAI). 
This Inventory was developed at HumRRO Central Division (D) for the purpose of 
evaluating the predictive potential of certain demographic and attitude variables, such as 
history of willingness to participate in dangerous sports and expressed confidence in one's 
ability. The BAI did not add any predictive capability over other variables available 
v^thout a special test administration.*^ The birth order variable was eliminated as a 
potential predictor on the basis of a study by Prunkl."^ Thus, these two attempts to add 
apparently good predictors by administering psychological instruments to the students 
failed to produce anything worthy of inclusion. Since it was desired that no new 
administrative burden be placed on the Army in the form of administration of tests or 
development of data not already part of the normal Army system, and in view of the 
failure to come up with strong evidence to support their inclusion, it was decided that no 
variables or test scores would be included in the PREDICT system other than already 
pre-existing Army data. 

■' ■ 

' Shoenberger, Wherry, and Berk.shire, op. cit. 
^Wahlberg, Boyles, and Boyd, op. cit: 
^Boyles, op. cit. 
'*Prunkl, op. cit. 
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One potential pre-existing predictor was not included. The Pilot Performance 
Description Record (PPDR) is a standardized performance rating scale given during 
checkrides at the Primary Helicopter School.' Unfortunately, not all of the students in 
the FY69 and FY70 classes were administered the PPDR because of the time required for 
its administration and the sudden and dramatic increase in the number of aviators being 
trained at that time. These pressures have been relieved, and future analyses could utilize 
PPDR data. 

Many of the individual variables thiat were included in the data bank might be 
considered to be components of single, larger variables. For example, the mean of all of 
the flight grades prior to solo flight might be used in place of the individual grades. In 
view of the computational and data handling problems involved, and since predictions 
were required at seven different points during the course of training, means were taken 
that represented the student's progress to that point in each of the flight, academic, and 
Warrant Officer Development areas at the time that a given equation was computed. 

All Oi the variables recorded in the data bank are shown in Appendices A-C. Of the 
larger number, some 36 variables were actually used in the equations at one point or 
another. These are given in Table 8. A comparison of the variables in this table with the 
variables listed in Appendices A-C will show that there are many that were neither used 
individually, nor collapsed and used collectively. The individual variables were examined 
for their predictive potential prior to inclusion in the multiple regression format. Those 
which, upon inspection, showed a low correlation with the criterion were excluded from 
the analysis. Most of these were nominal information. That is, they were simply classifi- 
cations such as commission source (Academy, ROTC, etc.). This type of information 
often has a very low predictive powder due to the insensitivity inherent in having only two 
or three categories into which everyone must be placed, and to the lack of any ordinal 
relationship among the categories. The possibility of the existence of suppressor variables 
was not treated in this analysis. 

Where a nominal variable appeared promising, two choices were considered for the 
treatment of 'nominal data. The first choice uses data as modifier variables. Each category 
defines a separate subpopulation for which separate equations would be calculated. The 
disadvantage of this approach is that it fractionates the sample population and multiplies 
the number of equations necessary for adequate prediction of the entire population. 

The second alternative, known as the **pseudovariable technique,'' avoids this 
problem.- In this technique, each of the categories of a nominal variable—such as hair 
color— is treated as a separate dichotomy. A zero or one is entered in each category for 
every subject; the zero indicates that the categoiy is not correct for that subject v/hile a 
one indicates that it is. In the example, if the sample is divided into blondes',' brunettes, 
and red-heads, a red-headed subject would receive a one for that category (i.e., variable), 
and a zero for the other two categories. Each of the separate categories is then entered 
into the multiple regression format as a separate variabk*. 
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^ George D. Groer Jr., Wayne D. Smith, and Jimmy L. Hatfield. Improving Flight Proficiency 
Emluation in Army Ilolicoplcr Pilot Training, HumRRO Technical Repor* 77, May 1962. AD-276 115. 

George D. Greor, Jr,, Wayne D. Smith, Jimmy L, Hatfield, Carroll M. Colgan, and John O. Duffy. 
PPDR Handbook: Use of Pilot Pcrfonnance Description Record in Flight Training Quality Control, 
HumRRO Research By-Prodiicl, December 1963. 

John O. Duffy and Carroll M. Colgan. /V System of ! light Training Quality Control and its 
Application to Helicopter Training, Consulting Report, June 19(ri. AD-'I19 081 
^Bottonherg and C';hristal op. cit ^ 
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Table 8 

Variables Used in Warrant Officer Regression Equations 







Population and Criterion 






rY 1969 


FY 1970 


FV 1970 




Variable 


Pass/Fail 


Pass/Fail 


Class Standing 


Rank (Enlisted Grade-CI Through E9) 




/ 


/ 


Age (Years) 




/ 

V 


1 
V 


/ 


Months Prior Service 


/ 


/ 


/ 


Education (Yea 


rs) 


/ 


/ 


• / 


Prior Flight Training (Yes/Mo) 


/ 


/ 


/ 


FAST Score (Actual Score) 


■ / 


/ 


/ 


GT Score (Actual Score) 


/ 




/ 


Number of Dependents 


/ 


/ 


/ 


AFQT (Actual Score) 


/ 


/ 


/ 


Marital Status (Yes/No) 


/ 


/ 


V 


Procurement Source (In Service/Enlisted) 


/ 


/ 


/ 


AME 1-7 




/ 


/ 


7 

V 


AME 1-8 




/ 






AME 1-9 




J 

V 






AME 8-9 
AME 8-10 


(X of Actual Scores) 


J 
V 


/ 


/ 


AME '8-12 




7 

V 






AME 10 






7 

V 


7 

V 


AME 11 






/ 


/ 


AME 13-17 J 




/ 






WDE 51-53 






. / 


/ 


WDE 51-55 




/ 






WDE 51-56 




J 

V 






WDE 54-56 
WDE 56-58 


y (X" of Actual Scores) 


/ 


/ 


/ 

r 


WDE 56-60 




/ 






WDE 57-59 






/ 


/ 


WDE 61-64 

J 




/ 






Pre-solo Flights 3-5 (X of Flight Grades) 


/ 






Pre-solo Flights 


3-7 (X of Flight Grades) 




/ 


/ 


Pre-solo Average 


/ 


/ 


/ 


Pre-solo Hours (Total Minutes 






/ 


Primary Flights 1-5 ("x of Flight Grades) 




/ " 


/ 


Primary Average 


/ 


/ 


/ 


Advanced Average 


/ 






Primary 1 Checkride Grade 




/ 


/ 
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CRITERIA 



Two criteria were used in this study. The first was pass/fail, the simple indication of 
whether or not an individual completed his helicopter training successfully through the 
advanced phase at Fort Rucker and was graduated. 

The second criterion was class standing, or end-of-course grade. The final end-of- 
course grade was based on the weighted scale used by Fort Wolters training authorities to 
arrive at class standing for the students. That weighted scale consisted of 45% flight 
grades, 35% military development points, and 20% academic grades. Tables 9 and 10 
provide the mettiod by which these scores were obtained for WOCs and officers, 
respectively. 

During primary helicopter training a student could earn a maximum of 1000 points. 
At the end of the primary phase these points ai'e ranked from high to low for all 
members of a given class and a class standing rank is assigned sequentially from the 
highest to the lowesi points eai'ned. The first column of Table 9 shoves the three major 
components from, which these 1000 points are derived. The-Kubject areas for which the 
student is gi'aded are outlined in column 2. For the flight grades, column 3 outlines the 
factors for deriving the total overall points which can be earned for each of the subject 
areas listed in column 2. For the academic and military development evaluations, 
column 3 is a description of the examinations or evaluations and also lists the maximum 
overall points that-can be Mwaixled for each. Column -1 is the sum of the points available 
for each of the three m^ijor components of the overall available points. The procedure 
and weights for deriving the maximum points which are included in a student's end-of- 
course grade are outlined in the fifth column, while column 6 is the maximum points 
available for each of the Lh^'oe major areas. 



STATISTICAL ANALYSES 

The first step in the analysis was to determine the nature of the relationships among 
the various pairs of variables. That is, it was necessary to determine whether the variables 
should be entered in their raw form, or whether some transgeneration should be made in 
order to convert the relationship between a pair of variables from c\ii*vilinear to linear. In 
order to do this it was first necessary to obtain plots of each pair of variables. This was 
accomplished using the BMD05D program from the Biomedical series by Dixon.' The 
paired frequencies for the variables were then sampled by hand and analyzed for the best 
fit relationship for an exponential curve, a power curve, and a linear relationship. In no 
case was the correlaHon using a transgeneration found to be higher than with a simple 
linear relationship. However, it is suspected that if the simple correlations were higher 
among the same variables, a transgeneration might be of advantage. 

Next, a stepwise multiple regression was conducted using a FIumRRO-generated 
program. This program computes a sequence of multiple linear regression equations in a 
stepwise manner. At each step, one variable is added to the regression equation. The 
variable added is the one that malces the greatest reduction in the error sum of squares. 
When the addition of another variable will make no further reduction in the error sum of 
squares, th'^ program automatically terminates. Ilowever, it was found that the 
overwhelmmg majority of the variance was account f^l for by the first five or fewer 
variables in the stepwise, program. Since a large number of equations would be used by 



' W. J. Dixon. ((>d.) BMi) Bio Medical Computer Proj^r^ fn.^, Universily of California Press, Los 
Angeles, 1 070. 
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the training personnel, it was decided to make the length oT the equations uniform in 
order to avoid confusion. The best five predictor variables were used in every case, even 
though, m some cases, one or more of those five made a negligible contribution. 
^ In order to provide as up-to-date a prediction as possible, at the most likely points 
in trammg where predictions could be used, the analyses were conducted at each of seven 
points durmg training for the total population, and at each of three points for the 
population of students nominated for possible expulsion (the SERC population) The 
severi pomts are given in Table 11 for the total population analyses and in Table 12 for 
the bERC population analyses. Only three equation periods were used in the analysis of 
the SERC popidation because the smaller population could not reasonably bo further 
subdivided. It should be noted that the officer syllabus has only two weeks of preflight 
while the woe has four. There was also a syllabus change, reducing both overall 
programs by two weeks. 



Table 1 1 



Relationships Between Regression Equations and 
Time in Training 



Equation Number and Nanne 



1. Start Preflight 

2. ^nd Preflight 

3. End 5th Graded 

Pre^Solo Flight 

4. End 7th Graded 

Pre- Solo Flight 

5. End Pre-Solo 

^6. End 5th Primary Flight 
••7:'-£nd Primary I Flight 



WORWAC 20-Week Syllabus 
ORWAC 18-Week Syllabus 



First Week Preflight 

Fourth Week Preflight (WORWAC) 

Second Week Flight Training 

Second Week Flight Training 
Fourth Week Flight Training 
Sixth Week Flight Training 
Ninth Week Flight Training 



WORWAC la-Week Syllabus 
ORWAC 16-Week Syllabus 



First Week Preflight 

Fourth Week Preflight (WORWAC) 

Second Wook Flight Training 

Second Week Flic)ht Training 
Fourth Week Flight Training 
Sixth Week Flight Training 
Eighth Week Flight Training 



Table 12 

Relationships Between Regression Equations and 
Time in Training— SERC Study 



Equation Nunnber and Name 


WORWAC ?0'WcPk Syllabus 


1. 


End Preflight 


First Week Preflight 


2. 


End 5th Graded Pre-Solo Flight 


Second Week Flight Training 


3. 


End 5th Primary Flight 


Sixth WcGk Fliglit Training 



The seven time periods are not evenly spread throughout the training program. 
Originally only three equations were furnished. Four others were added at times indicated 
by the SERC as being more important. This resulted in several equations being very close 
to one another in time. 
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RESULTS 



WARRANT OFFICERS 

Pass/Fail Criterion— Warrant Officers 

FY69 Sample— Total Population . Over 100 separate data entries were stored on each 
of the WOCs who completed training in the 1969 sample. An exact number cannot he 
given because some students received more grades than others, especially daily flight 
grades. Included among these 100 plus variables were a large number that were part of 
sequence of grades. For example, each of the Warrant Officer Development Examinations 
and each of the Airmanship Examinations was included as a separate entry. When the 
individual components of a given sequence were combined in such a way as to provide a 
single index for that sequence, such as the mean pre-solo flight grade, the number of 
variables was reduced. Twenty-five variables are listed in Table 13. However, no more 
than 21 were used in any one analysis. 

The collapsing of variables by summing them, or taking their average, rather 
than using the total number of variables individually has at least two advantages, and at 
least one disadvantage. One advantage is purely statistical. The fewer variables you 
examine with the same size population, the more reliable your multiple correlation 
coefficient will be because fewer degrees of freedom are used. The second advantage is 
also statistical in nature, but is more easily grasped intuitively. As measures which are 
basically very similar in nature are combined (e.g., by taking their mean), the reliability 
of the combined index increases, since the mean of several measures is more reliable than 
the individual measures would be. The primary disadvantage is the danger that some 
indices which are really very different from one another will be combined simply because 
they happen to fall in superficially similar categories. In any event, all of those indices 
which appeared to be multiple measures of the same type of behavior were combined 
into single measures. 

Table 14 provides the attrition of the 1969 sample by equation periods. The 
attrition data are also provided for the end of the Primary Phase of training and the end 
of the Advanced Phase of training even though no equations were provided for these 
times. ^ Looking at Table 14, it can be seen that a total of 518 students (18.5%) were 
attrited from the flight program by the end of their Primary Phase of training. Only 10 

'The reader should be aware of a confusion in Army flight program terminology that existed for 
many years. For reference, training given at Fort Wolters was referred to as the Primary Phase, while 
that given at Fort Rucker was often referred to as the Advanced Phase. The Rucker training was 
actually subdivided into an Advanced Instrument Phase and an Advanced Contact and Tactics Phase. 
This distinction between Primary and Advanced was often confused by the fact that the Primary Flight 
Training Phase, as conducted at Fort Wolters, consisted of what was called a "primary" and an 
**advanced" portion. At the end of the ''primary" portion (about the 13th week), a checkride was given. 
Upon pa.ssing this checki'ide, the individual proceeded to the "advanced" portion of his Primary Flight 
Training Phase. He then had to pass a second checkride to successfully complete the "advanced" portion 
of his Primary Flight Training Phase at Fort Wolters. Upon passing this second checkride, the individual 
proceeded to Advance-:! Flight Training Phase at Fort Rucker. To reduce the confusion resulting from 
the use of the terms "primary" and "advanced" within the Primary Phase, these portions of Fort 
Wolters training will be referred to as Primary I and Primary It, respectively. 
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Table 13 



Variables Submitted for Analysis, FY69 Warrant Officer Sample 

(Total Population) 









Standard 


Range of Values 






Mean 


Dnviation 


or Scores 


Rank (Enlisted Grade ~E1 Through E9) . 


2,1 


1.5 


1-9 


Age (Years) 




20.9 


2.7 


18-34 


Months Prior Service 


13.7 


28.2 


1-134 


Education (Years) 


12.9 


1.2 


9-19 


Prior Flight Training (Yes/No) 


0.2 


0.4 


1 or 0 


FAST Score (Actual Score) 


310.4 


36.8 


230-439 


GT Score (Actual Score) 


1 2.2., S 


/.2 


on 1 c 0 


Number of Dependents 


0.6 


1.0 


0-7 


AFQT (Actual Score) 


83.5 


11.2 


20-103 


Marital Status (Yes/No) 


0.3 


0.4 


1 or 0 


Procurement Source (In Service/Enlisted) 


1 .7 


0.4 


1 or 2 


AMEI.7 \ 




17.0 


1.2 


0-20 


AME1-8 1 




17.1 


1.2 


0-20 


AME 1-9 


> (X of Actual Scores) 


17.2 


1.1 


0-20 


AME 8-10 j 




17.6 


1.2 


0-20 


AME 8-12 J 




17.6 


1.1 


0-20 


WDE 51-55 ^ 




16.4 


1.3 


0-20 


WDE 51-56 
WDE 56-58 


1 (X of Actual Scores) 


16.5 
16.7 


1.3 
1.6 


0-20 
0-20 


WDE 56-60 ^ 




16.8 


1-4 


0-20 


Pre-Solo Flights 3-5 (X of Flight Grades) 


2.4 


0.6 


1-4 


Pre-Solo Flights 3-7 


2.4 


0.6 


1-4 


Pre-Solo Flight Average 


2.5 


0.5 


. . .1-4 


Primary Flights 1 -5 


2.6 


0.4 


1-4 


Primary Flight Average 


2.7 


0.3 


1-4 
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additional individuals were attrited during the Fort Rucker Advanced Phase of their 
training. For this reason, tHe PREDICT effort concentrated on Primary rather than 
Advanced flight training. 

Table 14 indicates that attrition was spread vei*y unevenly throughout the 
program, with the bulk of it occurring early in the program (as it should for economic 
reasons). Remember that the ''piim^u^" flights are completed by the end of the 13th 
week in a 20-week Primai*y Phajse program. A't this time the student is given a checkride. 
If he passes the checkride, he begins the second portion of his Primary Phase 
flight training. 

Dming FY69, the Primary Phase training program lasted for 20 weeks. Seven 
equations were provided to the Student Evaluation Review Council. These equations took 
advantage of all of the information available at these seven points in time in order to 
provide the SERC with as current an Cvstimate of a student's predicted performance 
as possible. 

Table 15 provides an ac'couiltihg of the examination and usage of the collapsed 
variables in the '^total population'' analyses of the FYGQ sample. The term ''total 
population'' refers to the fact that everyone in the FYGQ sample was included in the 
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equations, whether or not he was at that time nominated to appear before the Student 
Evaluation Review Council. A later portion of the Results Section will deal with a special 
study that used a subsample consisting solely of those individuals who were nominated to 
appear before the SERC. In Table 15, the numbers indicate the order of importance of 
the variables actually used in the equation; checkmarks indicate the other variables 
examined. Examination of Table 15 reveals that the demographic information that is 
available early in training tended to be used only until actual flight and academic records 
became available. As in previous research, early flight information is the best predictor of 
later flight performance. 

Table 16 provides the regression coefficients aiicl constsints, the variable means 
and standard deviations, the standard errors of the estimate, the goodness-of-fit F ratios 
and degrees of freedom, and the multiple correlation coefficients for each of the seven 
equations. Since these equations are based on the pass/fail criterion, their application 
results in an estimate of the probability of a given individual's successfully completing his 
helicopter training through graduation at Fort Rucker. 

Comparing Table 16 with Table 14, it can be seen that the multiple correlation 
coefficient tends to rise and fall with the proportion of individuals being attrited at any 
given time. This is a statistical artifact due to the decreasing proportion of individuals in 
the population who eventually fail as the students proceed through the later portions of 
training. However, looking at the standard errors of the estimate, it can be seen that even 
tliough the multiple correlation coefficient first increases with the time in the program, 
then decreases as attrition drops off, the standard errors of the estimate continue to 
decrease throughout the duration of the program. This suggests that the primary reason 
for the drop-off in the multiple correlation coefficient is statistical (i.e., due to the 
decreasing number of individuals being attxited), rather than to a drop in the inherent 
validity of the predictors. 

The standard errors of the estimate, especially for the early equations, are 
relatively large. It is believed that this is due primarily to the fact that attrition from the 
program has less to do with overall flight and grade averages than with ^the occurrence of 
critical incidents. While individuals are often attrited for low academic or flight averages, 
more are probably attrited for failures on checkrides, for disciplinary reasons, or other 
critical incidents. Thus, while these equations were useful, their limitations were quite 
clear, and it was necessary to take measures to increase the predictive capabilities. The 
first such measure taken was the analysis of the subpopulation of individuals who were 
nominated to come before the Student Evaluation Review Council. 

Utilization of 1969 WOC Pass /Fail Regression Equations. The regression coefficients 
given in Table 16 are weights which, when multiplied by the scores to which they 
pertain, furnish the predictive contribution of these particulai- variables. For example, 
utilizing the regression coefficients given for equation four, and utilizing scores for the 
"average man" for the five predictor variables required in that equation (i.e., Months 
Prior Service = 13.96, Marital Status = .31, etc.), it can be determined that the probability 
that the ''average man" will pass the course is .85.' 

FY69'-SERC Subsample . Of the 2,799 Warrant Officer Candidates in the FY69 
sample, excluding medical and self -initiated eliminations, a total of 715 individuals were 
nominated to appear before the Student Evaluation Review Council for possible 
expulsion from the program. Two sets of equations were developed on this population. 
First, equations were developed predicting the probability of successful completion of the 
course for the students prior to the Council's action. Thus, these equations predict both 




^Reference to Table 14 reveals that 2,444 students entered the period of training subsequent to 
Equation No. 4 and that 374 of them (i.e., 211 + 39 + 64 + 60) subsequently attrited at Fort Welters. 
This is 15% of the total and compares with the pair probability of ,85 computed above. 
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the current action of the Council, and its future action upon setbacks. The second set of 
equations was computed on' those individuala who were set back (i.e., not eliminated 
from the program by the current action of the Council). This set of equations predicted 
the performance of those individuals who are given a second chance. Only three equation 
periods were used instead of the seven used in the total population sample because the 
smaller number of individuals in this sample required their combination into larger units 
in order to make the results more rehable. 

Tables 17 and 18 provide the regression coefficients and constants, the variable 
means and standard devip/tions, the standard errors of the estimate, the goodness-of-fit F 
ratios and degrees of fi^eedom, and the multiple correlation coefficients for each of the 
three equations for the **before SERC" and '*after SERC groups, respectively. The three 
time periods used in the equations are given as headings in Tables 17 and 18. 

A comparison of Tables 17 and 18 with Table 16 reveals Uttle statistical 
improvement in the equations. The multiple correlation coefficients are about the same. 
However, the SERC equations are based specifically on the populations in which there is 
a greater interest, namely the population of individuals who have been nominated to 
appear before the Review Council. Therefore, in spite of the fact that little improvement 
was shown statistically, the Student Evaluation Review Council reported a greater 
satisfaction in using the SERC equations as compared to the total population equations. 

Cross Validation of FY69 Sample . It was originally planned to cross validate the 
FY69 sample on the FY70 sample. Hqwever, the large number of syllabus changes 
occurring between FY69 and FY70 dictated that the FY69 sample not be cross validated, 
but rather that a new sample be gathered in FY70, and that this new sample be subjected 
to concurrent cross validation. 

FY70 Sample— Total Population . The total population of 1,826 WOC students in the 
FY70 sample was divided into two equal groups of 913 students for concurrent cros.s- 
validation purposes. The attrition data for one of these two half-samples are given in 
Table 19. Stepwise regressions were performed on the first of these two groups. The 
results of these analyses are given in Table 20. Two equation 7s are shown in Table 20, 
one excluding and one including the Primary I checkride as a predictor. The checkride 
grade was not available on everyone in the sample. 

Comparing the results of these analyses with those of the FY69 sample, it can 
be seen that there is a worthwhile improvement in the multiple correlation coefficients. 
In addition, it can be seen that the standard errors of the estimate show the same 
consistently decreasing trend as in the 1969 sample. However, in spite of the 
improvement in the multiple correlation coefficients, greater predictive accuracy was 
desired. For this reason, a new criterion-class standing-was introduced into the analyses 
of the 1970 sample. These analyses are given in a later section. 

Cross Validation of FY70-Total Population Analyses . The regression equations given 
in Table 20, and based upon half of the 1970 sample, were used to generate predicted 
probabilities of passing for the other half of the 1970 sample. Table 21 provides a 
comparison of the original multiple correlation coefficients with the correlation-between 
the predicted probability and the actual pass/fail record of the second half of the 1970 
sample. None of the differences between the correlations is significant at the p < .05 
level. In addition, there was very little shrinkage' in tlie cross validation correla- 
tion coefficient. 



cross validation correlation coefficient is obtained by computing the con-elation of the 
weighted .sums of the predictors with the criterion in a new sample. The difference between this 
correlation and the original correlation is called shrinkage. (C.I. Mosier. 'Troblems and Designs of 
Cross- Validation," Joimuil of Eciitcalional qncl Psychological Measurement.; vol. 11, 39'51, pp. 5-11), 
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Table 19 

Warrant Officer Candidate Sample Size, FY70, by Equation Period 





Efjuation Period 




Preflight 


Pre-Solo 


Primary 1 Flights 


Population 


Start 
Preflight 


End 
Preflight 


End 
5th Graded 
Pre-Solo 
Flight 


End 
7th Graded 
Pre-Solo 
Flight 


End 

Pre-Solo 


End 
5th Graded 
Primary 
Flight 


End 
Primary f 
Flights 


One-half Student 
Population Within 
Each Equation Period 


913 


890 


848 


845 


741 


709 


500 


One-half Student 
Population Passed at 
. Each Equation Period 


636 


626 


634 


635 


643 


640 


475 


One-half Student 
Population Failing 
Within E^ch Equation 
Period 


277 


264 


214 


210 


98 


69 * 


25 
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Class Standing Criterion— Warrant Officers 

As has been noted, one of the purposes of PREDICT was to aid agencies such as the 
SERC in integrating the information pertinent to pass/fail decisions for individual 
students. While the multiple correlations obtained were quite respectable for a secondary 
selection process, it was obvious that higher accuracy in predicting the criterion would be 
desirable. Another factor of concern was the nature of the criterion being predicted. 
Reference has already been made to some of the problems with the pass/fail criterion, 
such as the great influence of critical incidents and the effect that the pass/fail ratio can 
have on the multiple correlation and, hence, the accuracy of prediction. In addition, 
there were administrative problems in connection with the SERC's ability to use the 
predictions, since virtually all students appearing before the SERC would have pass/fail 
probabilities in excess of .50, Statistically, this was correct, but conceptually the SERC 
was uncomfortable with a system that predicted the students whom they were washing 
out had substantial probability of passing. 

For these reasons, a predictive criterion that did not suffer these problems was 
sought. It was thought the prediction of percentile ranking of all of the individuals in the 
course would be such a criterion. It is a criterion that is easy to interpret. Unfortunately, 
percentile class ranking is not a criterion that is easy to work with mathematically, as it 
lacks the characteristics necessary for parametric statistical computations. However, final 
end-of-course grade does have the desired mathematical characteristics, and the percentile 
class standing can be computed from the distribution of final end-of-course grades. 
Therefore, equations were developed to predict this variable. A conversion graph is used 
to obtain the percentile class standing. 

Table 22 provides the regression coefficients and constants, the variable means and 
standard deviations, the standard errors of the estimate, the goodness-of-fit F ratios and 
degrees of freedom, and the multiple correlation coefficients for the equation at each of 
the seven time periods. Comparing the data in Table 22 with those in Tables 16, 17, 18, 
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Table 21 



Comparison of Multiple and Cross-Validation 
Correlation Coefficients for Pass/Fail Criterion, 
FY70 Warrant Officer Candidates Sample 



Equation 


Multiple 
Correlation Coefficient 


Crosfj-Validation 
Correlation Coefficiont 


1. 


Start Preflight 


.23 


.22 


2. 


End Preflight 


.33 


.28 


3. 


End 5th Graded Pre-Solo Flight 


.42 


.39 


4. 


End 7th Graded Pre-Solo Flight 


.43 


-48 


5. 


End Pre-Solo Flight 


.37 


.35 


6. 


End 5th Graded Primary Flight 


.31 


.22 


7. 


End Primary I Flights 


.21 


.17 



and 20, that deal with the pass/fail criterion, it can be seen that multiple correlation 
coefficients for the end-of-course grade criterion are considerably higher (R = .38 to .80) 
than those for the pass/fail criterion (R = .17 to .48). 

Figure 1 provides a graphic display of the relationship between end-of-course grades 
and percentile ranking within the class. It can be seen from Figure 1 that an individual 
mth a score of 83.25 would be at the 50th percentile of his class, while an individual 
with a predicted score of 90.5 would be at the 99th percentile of his class, and an 
individual with a score of 75.75 would be at the first percentile of his class. 

Another feature of this graph is the ability to calculate probability limits. For 
example, if you wished to calculate the 90% (Confidence limits within which a given 
individual who has a specific predicted end-of-course grade will actually fall, you would 
first consult a table of the normal distribution to determine how many standard deviation 
units above and below the mean will encompass 90% of the population. This, number is 
1.65. Using, for example, equation four (end 7th Graded Pre-Solo Flight), the standard 
error of the estimate is equal to 1.974. This multiplied by the constant of 1.65 given a 
90% boundary range equal to the predicted score ±3.26. Again using an example, suppose 
the individual's predicted end-of-course grade is 80. The range within which his actual 
grade should ftill, at the 90% level of confidence, would then be from 76.74 to 83.26. 
Consulting Figure 1, it can be seen that his most probable actual percentile position 
would be at the 16th percentile, with his 90% probability range extending from the 
second percentile to the 50th percentile. Thus, you could say with some assurance that 
this individual will not complete the course with an end-of-course grade in the upper half 
of his class. 

Cross Validation of the Class Standing Criterion . Table 23 presents the multiple 
correlation coefficients for the seven regression equations along with the correlation 
between the predicted end-of-course grade for the second half of the 1970 population 
and the actual end-of-course grade. The predicted end-of-course grade was based upon the 
equations derived from the first half of the 1970 sample. Thus, the correlation between 
the predicted and actual scores represents in this case a cross-validation con;eIation 
coefficient. A glance at Table 23 reveals that there was comparatively little shrinkage' in 
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Table 23 



Comparison of Multiple and Cross-Validation 
Correlation Coefficients, FY70 Warrant Officer Candidates Sample, 
Class Standing Criterion 



Equation 


MuUiple 

r*ni*rpl;^tinn r*npffIr(Pnt 


Cross-Validation 


1. 


Start Preflight 


.38 


.33 


2. 


End Preflight 


.63 


,55 


3. 


End 5th Graded Pre-Solo Flight 


.68 


.61 


4, 


End 7th Graded Pre-Solo Flight 


.71 


' .63 


5. 


End Pre-Solo 


.73 


.69 


6. 


End 5th Graded Primary Flight 


.78 


.69 


7. 


End Primary i Flights 


.80 


.67^ 



Differences betvwen original and cross-validation correlation coefficient significant at 

p<.05. 



the cross-validation correlation coefficient. Among the seven pairs of correlation 
coefficients tested, only one pair, that for equation seven, tested significantly different at 
tlie .05 level. 

Verbal Description of Successful Warrant Officer Candidate 

The successful aviation Warrant Officer Candidate has a sHghtly higher rank than his 
peers, indicating that he was obtained from in-service sources. Similarly, he is sHghtly 
older than his peers. If he has more time in service, his probability of successful 
completion is higher. On the other hand, his end-of-course standing is likely to be lower 
with more time in sendee. The successful Warrant Officer Candidate is better educated 
than his peers. He probably received some flight training prior to entering the Primary 
Helicopter School course. His FAST score is higher, but his GT score is of no 
consequence in determining whether he will pass or fail the course. If he is married and 
has children, his probability of passing is greater, but this has little effect on his final 
end-of-course grade. The successful aviation Warrant Officer Candidate scores well on the 
APQT. By definition, he does well on his Airmanship Examinations, Warrant Officer 
Development Examination, and flight grades. 



OFFICERS 

Pass/Fail Criterion—Officers 

The same type of data were stored on the officers as on the Warrant Officer 
Candidates, with a few exceptions. No FAST scores were available on the officers 
without using the facilities of the Armed Forces Records Center at St. Louis, Missouri. 
Since this retrieval would have been manual, and would have required more manpower 
resources than were available, this variable^ was not retrieved for the officers. 

'Table 15 shows that the FAST variable appGarcd only in the first two predictive equations (i.e., 
"Start Preflijiht^' and "End Preflight'^), for the Warrant Officer Candidates. After that point it was no 
longer an effecUve predictor. Since the officers do not receive the same PreHi^jht training phase as do 
the WOCs, one may surmi.se that little was lost for the officers through the omission of the FAST. 



52 50 



Since the officer population (because of 
their previous officer training) does not need 
the military development that Warrant 
Officer Candidates require, the Officer 
Development Examinations which they 
receive during their aviation training are not 
as frequent, as long, or rated as important as 
the Warrant Officer Development Examina- 
tions which the Warrant Officer Candidates 
receive. The Airmanship Examinations were 
identical in content, but were scored dif- 
ferently using a different weighting for 
officers as compared to Warrant Officer 
Candidates. The scores of officers and 
Warrant Officer Candidates on these exami- 
nations cannot be compared without taking 
this different weighting into account. 

The officers' records also lack the 
standardized tests that are given to enlisted 
liien as they are inducted into the service. 
These include the AFQT and the GT. After 
the available variables were collapsed for the 
officer population in the same manner as for 
the Warrant Officer Candidate population, 
the number of variables for use in the regres- 
sion analyses was reduced to the 18 listed in 
Table 24. 

Table 25 provides the attrition data for the officers in the 1970 sample by equation 
periods. Looking at the first and last figures of row 1 of Table 25, it can be seen that 
only 80 students (6.6%) were attrited from the officer population by the end of their 
Fort Wolters training. Many were failed during a given'^period only to be reinstated and 
eventually passed so that, in net, only 80 failed. With an attrition rate this low, the 
PREDICT equations have relatively little utility for secondary selection. On the other 
hand, there is an increasing interest in counselling students during training to assist them 
in gaining the maximum from the training program. The regression equations on the 
officer sample could be of value in such an application. 

Table 26 provides the regression coefficients and constants, the variable means and 
standard deviations, the standard errors of the estimate, the goodness-of-fit F ratios and 
degrees of freedom, and the multiple correlation coefficients for each of the seven 
equations. The rise and fail of the multiple correlation coefficients with time in the 
program is not as noticeable for the officer sample as it was for the warrant officer 
sample. This is true in part because the attrition in the officer sample, edthough it is less 
than the Warrant Officer Candidate sample, is spread more evenly throughout the training 
program. The standard errors of the estimate show the same general decline from the 
beginning to. the end of the program as they did w?,tii the Warrant Officer Candidate 
program, except for one reversal on the fourth equation. The pass/fail equations have the 
same problems for the officer population as they did for the warrant officer population. 



Table 24 . 

Variables Used in 
FY70 Officer Regression Equations 

Age (Years) 

Months Prior Service 

Education (Years) 

Prior Flight Training (Yes/No) 

Number of Dependents 

Marital Status (Yes/No) 

AME 1-7 (X of Actual Scores) 
AME 8-9 (X of Actual Scores) 
AME 10 
AME 11 

ODE 9-10 ('X of Actual Scores) 

Pre-Solo Flights 3>5 (X of Flight Grades) 
Pre-Solo Flights 3-7 (X of Flight Grades) 
Pre-Solo Average 

Pre-Solo 04-15 Hours (Total Minutes) 
Primary Flights 1-5 (X of Primary Flights) 
Primary Average 
Primary I Checkride Grade 



Cross Validation of Officer Pass/Fail Analysis 

Table 27 presents the multiple correlation coefficients for the regression equations 
along with the cross-validation con-elation coefficients. The predicted pass/fail probability 
was based upon only one-half of the 1970 sample. Using the regi'ession equations 
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Table 25 



Officer Sample Size, FY70, by Equation Period 









EquaUon Period^ 








Prefliqht 


Pre-Solo 


Primary 1 Flights 


PopuJrjtian 


Start 
PrefiKihr 


End 
Prefljght 


End 
5th Graded 
Pre-Solo 
Flight 


End 
7th Graded 
PrG-*^ nln 
Flight 


End 
Pre-Solo 


End 
5th Graded 

r 1 1 1 1 Idl y 

Flight 


End 
Primary 1 
Flights 


Total Student Popu- 
lation Within F.irh 
Equation Period 


1206 


1165 


1225 


1156 


1162 


1162 


1126 


lation Passed at Each 
Equation Period ' 


1094 ' 


1056 


1105 


1059 


1105 


1105 


1105 


Total Student Popu- 
lation Falling Within 
Each Equation Period 


11? 


109 


120 


97 


57 


57 


21 


Percent Failmg Within 
Each Equation Period 


9.3 


9.4 


9.8 


8.4 


4.9 


4.9 


1.9 



The total number of students reported for each equation period includes only those students for whom the neces> 
sary data, specific to that equation, wore available. It does not reflect the total student population at that time in 
training. Thus, the column totals cannot be manipulated to derive percentages, cumulative totals, etc. Many students 
who failed in one period were later reinstated and eventually passed, accounting for much of the discrepancy in this table. 



computed on the first half of the sample, predicted probabilities of successful completion 
were computed for the individuals in the second half of the sample. The cross-validation 
correlation coefficient represents the correlation between this predicted probability of 
successful completion and the actual pass/fail record of the second half of the officer 
populalion. With a pass/fail split as poor as is found in the officer population, you would 
not normally expect either a high correlation, or a very reliable correlation with 
tliis criterion. 

The cross-validation correlation coefficient is significantly different from the original 
correlation coefficient (p < .95) for both the first and the last equations. Equations three 
through six are considerably more reliable. Even so, it is worth noting that the highest 
con-elation of .315 accounts for only about 10% of the variance. Thus, any predictions 
based upon the pass/fail criterion should be used cautiously. 

Class Standing Criterion— Officers 

The sample examined and the general techniques used in examining them were the 
same for the class standing criterion as for the officer pass/fail criterion. Table 28 
provides the regi*ession coefficients and constants, the variable means and standard 
deviations, standard errors of the estimate, goodness-of-fit F ratios and degrees of 
freedom, and the multiple correlation coefficients for each of the seven equations. 
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Table 27 



Comparison of Multiple and Cross-Validation 
Correlation Coefficients for Officer Pass/Fail Criterion of 
FY70 Sample— Total Population 



Equation 


Multiple 
Correlation Coefficient 


Cross Validation 
Correlation Coefficient 


1. 


Start Preflight 


.12 


.00'-' 


2. 


End Preflight 


.12 


.08 


3. 


End 5th Graded Pre-Solo Flight 


.28 


.33 


4. 


End 7th Graded Pre-Solo Flight 


,28 


.30 


5. 


End Pre-Solo 


.25 


.28 


6. 


End 5th Graded Primary Flight 


.32 


.30 


7. 


End Primary 1 Flights 


.26 


.353 



^Differences between original and cross validation correlation coefficients significant at 
p<.05. 



The application of a regression equation results in an estimate of the final end- 
of-coujrse grade for a given student. The highest correlation with the class standing 
criterion accounts for 73% of the variance as compared to about 10% of the variance for 
the highest correlation using the pass/fail criterion. This correlation of .86 is achieved in 
equation seven which occurs at the end of the Primary I flights, or at approximately the 
halfway point in the Fort Wolters training program. The prediction here represents an 
extrapolation of future performance based upon the five best indices available 
approximately halfway through the training program. 

Figure 2 allows for translating the predicted end-of-course grade to a predicted 
end-of-course percentile class standing. The method for making this conversion Ls the 
same as that outlined for the Warrant Officer sample. 

Cross Validation of Class Standing Criterion—Officers 

The concurrent cross validation was conducted for the class standing criterion in 
the same manner as for the pass/fail criterion. Table 29 provides a comparison of the 
original multiple correlation coefficients with the cross-validation correlation 
coefficients, and provides the standard errors of the estimate as welL The shrinkage^ 
of the multiple correlation coefficient was not excessive. None of the shrunken 
multiple Rs differed from the original multiple Rs by an amount sufficient to reach 
significance at the .05 level. 

Verbal Description of the Successful Officer Aviator Trainee 

Compared to the Warrant Officer Candidate, little personal information is available 
on the officer aviation trainee. However, it can be said that the officer aviator trainee 
who scores well in his end-of-course standings is also a little older than his peers. 

^ Mosier, op. cit. 
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Table 29 



Comparison of Multiple and Cross-Validation 
Correlation Coefficients, FY70 Officer vSample, 
Class Standing Criterion 



Equation 


Multiple 
Correlation Coefficient 


Cross-Validation 
Correlation Coefficient 


1. 


Start Prefllght 


.28 


.31 


2. 


End Preflight 


.64 


.56 


3. 


End 5th Graded Pre-Solo Flight 


.71 


.64 


4. 


End 7th Graded Pre-Solo Right 


.74 


.69 


5. 


End Pre-Solo 


.80 


.77 


6. 


End 5th Graded Primary Flight 


.81 


.76 


7. 


End Primary 1 Flights ♦ 


.86 





However, he geaerally has. not been in the service as long as his contemporaries. He is 
somewhat above average in education, and has had some previous flight training. It is 
to his advantage to be married and to have children. 

SUPPORTING RAW DATA 

Appendices A-D of this report contain much of the raw data for the analyses 
(both officer and warrant officer for all criteria), along with descriptive statistics, 
intercoirelation matrices, and the listing of the regi'ession equations. 
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DISCUSSION 



The correlation coefficients wliich were obtained in this study are quite 
respectable. However, a few cominents on their interpretation are "probably worthwhile. 

Those equations dealing with the pass/fail criterion have a number of limitations. 
First, and perhaps foremost-, to the extent that they are used they will become a 
self-fulfilling propliecy. The pass/fail equations predict the action of the Student Evalua- 
tion Review Council (vSERC) or, more cun-ently, the Faculty Board. When a-student is 
nominated for povssible expulsion, he comes before a Boai'd for action. If the Board sets 
him back to another class, his chances of eventually passing are about the same as for 
students who never appeai-ed before the Boai'd. If the Board refuses to set him back, he 
has failed by definition. If the Boai'd were to take the pass/fail prediction, establish a 
cut-off point, and base its decisions exclusively on this prediction, the effective 
correlation of the equations with the action of the Board would become perfect. While 
this would have no effect upon the utility of the first set of equations derived, it would 
make it impossible to provide a realistic updating of those equations based upon new 
information, since that new information would be interactive with the previous 
regression equation. 

The situatioti is not as routine as described in the preceding paragraph. The Board 
does not use tiie pass/fail prediction as an exclusive guide to their actions. Most 
individuals are nominated for expulsion because of critical incidents such as a failed 
checkride. In addition, the equations are based not only on those individuals who are 
nominated to appear before the Board, but rather on all individuals in flight training. 
This further dilutes the tendency toward a self-fulfilling prophecy. However, the fact 
remains that this tendency is built into the pass/fail criterion. .Therefore, the pass/fail 
equations should not be used to nominate a candidate for expulsion. 

A second limitation of the pass/fail criterion concerns the effect of changing 
attrition rates. Predictive equations based upon an overall attrition of 15% v^ll yield 
unrealistic predictions of probable student success when the attrition rate changes (e.g., 
to 30%.) The relative position of the students should be the same, but a scalar shift is 
required for the predicted probability of successful completion for all of the students. 
Such a scalar shift can only be accomplished empirically, using new data. It is more 
efficient and accurate to generate a new set of equations based upon the data generated 
\/ith the new attrition rate. 

Another problem with the pass/fail criterion concerns the effect of a changing 
pass/fail split. During the course of training, the proportion of individuals ultimately 
failing decreasevS as a given class progresses through the training program. In the final 
week of training, it is not unusual to have no failures. Thus, the equations used early in 
training and based on the entire population may have a pass/fail split of 65/35. This is 
adequate for statistical purposes. Late in the progi'am, an equation may be based upon a 
pass/fail split of 99,5/0.5. Such an extreme split greatly reduces the reliability of the 
corre^lation coefficients obtained. 

It should 'also be notc^d that many of the individuals who are nominated for possible 
expulsion receive this nomination on the basis of a critical incident rather than a low 
overall average. For example, a Warrant Officer Candidate might be doing extremely well 
in both the academic and the flight portions of his training, but have a severe disciplinary 
incident with his TAG officer and be nominated for expulsion. Critical incidents such as 
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these, while they may be justified, do not fit well into a multiple correlation format. 
Although a variety of information is entered into the regi-ession analysis, training grades 
are the best predictoi-s. The pass/fail prediction is simply a second order reflection of an 
individual's overall class standing. Thus, critical incidents, reflecting attitudes and 
motivations, arc not predicted well. 

There is also, as previously noted, a practical user prolDlem relative to the predicted 
probabilities of success. Since a large number of those nominated for expulsion because 
of some critical incident have good academic and flight records, their predicted 
probability of passing is quite high. As stated eai'lier, experience has shown that the 
actual probability of passing is very high once a man gets past his first Board action 
TOthout being eliminated. In fact, his chances are about as good as they would be if he 
had never been boarded. Unfortunately, because the predicted probability is bound to be 
quite high, especially late in the progi'am, the users of the pass/fail equations are often 
placed in the uncomfortable position of having to pass judgment on men, all of whom 
are predicted to have an extremely high probability of eventual success. 

The class standing criterion circumvents a number of the shortcomings of the 
pass/fail criterion. Since the actu£il criterion predicted is end-of-course grade, changes in 
attrition affect the equation very little. There are no statistical problems with a lopsided 
pass/fail split, since it does not use one. It is not affected by the use of critical incidents 
to nominate the indi\ddual for possible expulsion. Since the class standing criterion is 
independent of Council action, there is no danger that it might become a self-fulfilling 
prophecy. There is also no embarrassment at having to fail a man who is predicted to 
pass. Rather, the Board can concern itself with the predicted quality of the student 
whom they are considering. For example, with two individuals nominated for possible 
expulsion for the same reasons, they may decide to keep one because he is predicted to 
perform well in the future, and to expel the other because he is predicted to perfom less 
well, even though he may also be predicted to pass. 

The value of these equations can be changed by the frequency with which sizeable 
changes are made in the training syllabus. For example, for the 1969 sample, the primary 
helicopter training program lasted for 20 weeks, and contained 17 Airmanship Examina- 
tions and 14 Warrant Officer Development Examinations. The progi-am at the ti-ne of the 
wrioing of this report lasts for 14 weeks, and has eight Airmanship Examinatii and five 
Warrant Officer Development Examinations. Accommodations are necessary to equate the 
old system with the new when such syllabus changes occur, and these accommodations 
are less than perfect. In order to be maximally effective, equations should be updated 
frequently, based on data as close to the cun-ent classes as possible. This will gi'eatly 
reduce, the effect of syllabus changes on the accuracy of the predicted equations. 

There is a second area where these equations could be used with considerable value. 
The equations were originally intended for use in the decision-making process concerning 
whether a student who lias been identified as having a problem should be expelled from 
the progi-am or retained. The equations coidd also be used to identify students early in 
the program who look as if they v/ill drop below a satisfactoiy level in their average 
performance. Although many students are expelled for critical incidents rather than a 
poor overall performance, it is still true that a large proportion of the failures are attrited 
for flight and academic deficiencies. These equations might be used to identify students 
who are developing problems in the flight and academic areas before these problems 
become acute. In this area, both the pass/fail and the class standing criteria would be 
valuable. The class standing equations would provide an eariy extrapolation of an 
individual student's tendency to perform poorly in the ti'aining program. The pass/fail 
equations v/ould provide an index of the eventual seriousness of the problem. 

The primary virtue of the PREDICT system is its ability to produce an optimal 
summary of the infonnation availa])le on a single individual at any time during the 
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training program. The mass of information which the PREDICT system summarizes is so 
volummous and detailed as to defy an accurate and reliable interpretation without first 
determming the relative importance of the various types of information and developing a 
mechanism for trading off poor performance on one indicator as compared to good 
performaiice on another indicator. The PREDICT system provides both an indication of 
the relative importiuice of the available information and a mechanism for summarizing 
the mfonnation from the several indicators. 

At the beginning of this report the distinction . was made between primary and 
^condary selection. Such distinctions, while perhaps an administrative necessity, often 
distort our view of the requirement that selection and training must exist in an integrated 
personnel system if Hie services are to utilize manpower resources with maximum 
elliciency. Neither selection nor training can be viewed as independent of or segregated 
from othPr aspects of the total personnel system. Therefore, primary selection programs 
and secondary selection procedures such as that described here must be placed into the 
larger system context. Several aspects of the PREDICT program that did not fit well with 
the training system (e.g., operational use of the pass/fail prediction criterion) have been 
described, iiowever, adjustments in those areas would be possible in future implementa- 
tions of the system. The basic methodology involved in multivariate extrapolation of 
aviator performance offers considerable potential for effective application, both in 
training and m other areas of performance. 

The prediction of future performance is probably one of the most important 
functions of management. Wherever a prediction of the future training performance of 
students cuiTently enroUed in the training progi-am would be valuable, the PREDICT 
system would be valuable. This would include not only the current uses, but also student 
counselling and training program management. The same data pool gathered for the 
purpose of predicting student performance might also be useful in predicting performance 
after graduation. 
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Appendix A 

SUMMARY OF DEMOGRAPHIC DATA AND THE COLLAPSED 
VARIABLES USED IN THE REGRESSION EQUATIONS, 
WARRANT OFFICER CANDIDATES 1969 SAMPLE 
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.. . Table A-2 

Frequency Counts for Varieibles Used in Analyses, 
woe 1969 Sample: Fort Wolters' Flights 
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Table A-2 (Continued) 



Frequency Counts for Variables Used in Analyses, 
woe 1969 Sample: Fort Welters Flights 



Flight 

M ( 1 rnhnr 


Grade 


X 


Mdn 


0 
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Missing 
Data 


1 .0 
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'^P 02s - Second Supervised Solo v 

34 - Syllabus lessons P 34 through P 39 were used to award additional flight time to 
students who did not successfully complete P 32 (checkride). P 33 not assigned. 
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Appendix B 

SUMMARY OF DEMOGRAPHIC DATA AND THE COLLAPSED 
"ARIABLES USED IN THE REGRESSION EQUATIONS, 
WARRANT OFFICER CANDIDATES 1970 SAMPLE 
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Table B-2 



Frequency Counts for Variables Used in Analyses, WOC 1970 Sample: 

Fort Wolters Flights 
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Number 
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Table B-2 (Continued) 



Frequency Counts for Variables Used in Analyses, WOC 1970 Sample: 

FortWolters Flights 



Flight 
Number 


Grade 
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34 - Syllabus lessons P 34 through P 39 were used to award additional flight time to students 
who did not successfully complete P 32 (checkride). P 33 was not assigned. 
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Appendix C 

SUMMARY OF DEMOGRAPHIC DATA AND THE COLLAPSED 
VARIABLES USED IN THE REGRESSION EQUATIONS, 
OFFICER 1970 SAMPLE 
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Appendix D 

ir4'rE.RCORRELATl5N MATRICES FY69 AND FY70 SAMPLES 
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HumRRO Division No. 6 (Aviation) 
Fort Rucker, Alabama 

WORK UNIT PREDICT PROGRAM PAPER 

11 May 1970 

Annex I 

Technical research plan for the development of (1) an operational 
predictor system for rotary wing initial flight training, and (2) 
a method of selection for helicopter gunnery training. 

(PREDICT I) 

INTRODUCTION 

The objective of this Annex to the PREDICT Work Unit Program Paper 
are to provide : 

1. A list of variables to be included in initial correlation matrices. 
Regression equations derived from these matrices will predict the success 

or failure of individual trainees in the initial entry Officer Rotary Wing 
Aviation Course (ORWAC) and Warrant Officer Rotary Wing Aviator Course 
(WORWAC) . The list includes sources of the variables. 

2. A rationale for inclusion in the matrices for each variable listed. 

3. A description of the method for * collection , coding and computer 
storage of information for each variable. 

4. A brief rationale for the method of analysis. 

5. A description of the implementation system for the predictor 
equations to be developed. 

6. An exposition of plans for experimental evaluation of additional 
variables not included in the original matrices. 

7. A description of the application of data compiled in paragraphs L 
and 6 above to the prediction of performance of students in helicopter 
gunnery training. 
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Section 1 



VARIABLES TO BE INCLUDED IN INITIAL >IATRIGES 
Ao XdeiLtif l.catj^on^ l^TA^h^S-^.^ 

For FY 69 classes., che primary source for these variables was the 
'^Initial Data Priatout" (IDP) , a personnel management roster used for 
trainee control at the Uo So Axmy Primary Helicopter School (USAPHS) , 
Fort Wolters; Texas ^ It contains Identification^ demographic, bio- 
graphical^, and assignment information and selection test scoreso .Some 
of this j-xiformation is transcrihed from the primary enlisted and officer 
personnel records,, Forms 20 and 66 respectively, during the first week 
of ORWAC and WORVJACo Other portions of the information are obtained from 
the student o The combined data are compiled for IBM cards punching on a 
summary personnel document informally titled '^the Block Form'* (BF) o 
The IDP is generated from the BF cards o For FY 70 classes, USAPHS trans- 
mits the IBM cards containing BF information directly to the HumRRO 
Computer Center (,HCC)o The identification variables are? 

lo Cl^ssJ^IumbeTo This is the number assigned a flight class by 
USAPHSo This ^four-digit hyphenated number contains the fiscal year of 
the flight class as the first two digits and the sequential number of the 
class wichin that fiscal year as the last two digits □ Classes are numbered 
within the year from 01, with odd integers assigned to WORWAC and even 
numbers assigned to ORWAC classeso For' example, class 69--05 WORWAC was the 
fifth flight' class to begin at Fort Wolters during fiscal year 1969 o 
(Because of the odd^even alternation, it was the third aviation Warrant 
Officer Candidate (WOC) class to begin during that fiscal year^) 

2o Class roster number o A within-class identification number is 
assigned^t^o 'students "in alphabetical order o It varies from one to three 
digits with categories of personnel identified by specific series of 
numbers o An explanation of these categories is included in Appendix 1. 

3o Social Secu^itv^^Accou^^ This nine-digit nttmber has 

replaced'^the'Smy setial numberc 

With the exception of marital status values for these variables are 
obtained frcm the IDP^ 

lo Pro^urement_sm^ A one-digit code categorizes the WOC as ^ 
flight traxninY' enlistment option (EO) or in service (IS). EO candidates 
come into the aviation training program from civilain status while IS 
personnel come fron enlisted active duty assignments o For officer students, 
procurement source reflects the source of commission or warrant, ioCo, 
OCS, direct appointment^ ROTC, or Academy o 
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2., Rank, Ihis vaclable^ in che case of WOCs^ shows enlisted rank 
priox zo entering the flight programo While the ranks of TOCs do not 
change during rrainmggj the ranks of officers may changeo For matrix 
pu3fposes, lank at time o£ entry into the RoCA*.ry Wing Aviator Course will 
be used for officetSo 

3o ^^^0 This variable reflect* the student* a age in yeatv at last 

birthday befox^ Btitex±xxg the filghr prro^amo 

4o ^^nch:> Vo^ TOfiiaifteioned officer students this designates 
orcnxpa'cionai s^ategorles such a.s intantry^ artillery^ and engineerso All 
VBTTavLZ officers attending OKWAC are iKiembers of the Aviation Warrant 
Officer Branch 0 This variable will not .appear in the matrices foy WOCSo 

^« MM^,J^i£j'3Ao Flight training received prior to entry into 
the Army ^8 aviatian chaining program is r^fleeted by this variable o The 

eategorlea used are described in Appendix lo 

6o ^^^^l^jtatuBo Thi6 information is obtained from the Form 20 
for WOCs and tram the^Form 66 for officerso Students are categorised 

as single g> married or divorced □ 

cSfe^S|onal^J^;elo This information is categorized in terms of 
years of formal civilly education COTipletedo GED equivalents are not 

dif f eren t i at ed o 

8o Jl2aSM:=al=SS;ig£.Jl^^^ These da^ta consist of months of federal 
military service accujnulated by the student prior to entry into aviation 
training 0 

9o JiiS3^^==gJLJj2§firfMi£o Number of dependents claimed by the student 
at th«i thm of entry into ORWACA/ORWAC is reflected by this varlableo 

^M^SSM=:M&^^!$$Zo This variable reflects administrative progress 

actions applied to stu3e,nt&o ' Examples are eliminations and. setbackso A 
complete list of {categories is included in Appendix lo These actions are 
shown on the Corrected Initial Roster (CIR) which is prepared at each of 

the training ^ente;ts upon graduation of a flight class o 

2o 2mMM^M...c^^M^.JMML.^^^^^ This variable designates 
the location at which the student receives advanced rotary wing training© 
At the completion of the primary phase at Fort Wolters^ some students 
report to Fort Stewar t«Hunter Army Air Field^ Georgiap ar.d others to the 
Uo So Amy Aviation School (USAAVNS) at Fort Rucker^ Alabflmso The assign- 
ment of students to chese locations is indicated on the USAPHS Pinal Class 
Standing Roster ^ For officer students ^ all USAPHS training is designated 
as Phase lo For WOCs the four-week pref light period is termed Phase I 
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and flight training is^ designated Phase Ho Thus, the Initial phase of 
advanced training (i e ., at Rucker or Huater-Stev/art) is Phase III for 
WOCa but Phase II for officer students o 

Do PretrainjLng J^'^^-P.t3^^Jz9J}j' 

^ ° ^ii^ii ^^.^i^^^^^^^J^i ?^.£Ei£S^§i£l£° '^^ 

information^ ^obtained^trom the^lSTj, is the student^ s overall score on 
the primary selection battery, the Flight Aptitude Selection Tests, 
constructed and monitored by the U. So Army Behavioral Science Research 
Laboratory^ The Tnirilmuan score for selection is 250 for the Warrant 
Officer Rotary Hing Aviator Battery and 155 for the Officer Rotary Wing 
Aviator Battery c, 

2. Armed JJ'o^ces^^ua]^^ This information, 

applicable'^to UOCs only, is taken from Form 20s for WOGSo It reflects 
the numerical score on the Armed Forces Qualification Testo 

3o Genera]^ Techni^^ This score, 

applicable'to'^IvOCs only /is obtailied from the IDP and is derived from 
the verbal and arithmetic aptitude subtests of the Armed Forces Qualifi- 
cation Test CAFQT) or the Army Classification Battery (ACB) , 

1^ Fort_^?o3J:£rs_acade Presently, 17 academic examinations 

in airmansiiip are admixTisteredo On each^ the maximum score is 20 and 
the minimum passing score X4o The content areas covered by these 
examinations are as follows 

a 3 Airmanship Examination (At'ffi)~lo The development of the 
helicopter, rotary wing aerodynamics and aircraft orientation, hardware , 
structures ;j wear factors, and safetying procedures o 

b, AME-2 . Helicopter airframe^ technical publications, 
rotor performance J main rotor/tail rotor system, and helicopter 
vibrations n - ~ 

c. AI^IE-3. Flight controls J aviation fuels, powerplants. 
and aviation lubricants o 

• dr A^^tE~4- Powertrains, electrical systems, instrioments , 
helicopter systems review, and aircraft systems checks o 

e. A>rE-5 Praf lights-post flight procedure, cockpit procedures, 
ground handlings par'king and mooring, communication procedures and radio 
phraseology, and clouds^ 

f, A>IE'-5 Frontal weather aircraft forms and records, 
aircraft inspection, and aircraft accident procedures o 
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g i^^M' / fiigliL xii;e pt^icti^al exercise In preflight and 
cocikpic proccdai^'£- , NCcMSure^ 'nnds ^ air cltculaclon^ air massesj, 
Teletype sequence leporxs, and sutface wtxacher mapSo " 



.h... AlHiE:-8 locdl antiri otleattition, scxaighc and level flightg, 
a tiighc line pra:.tti:aL eKCitcii^a in prer'Iigbt "and* tockpit procedures^^ 
a flight line orienr.^cion, '.ilmb!!?^ curns^ and descents^ ground track 
maneuvetfa, av*)mal r'.ike«v*>.rf and Yanding^ autcroeatlons^ and auto^simulated 
forced landing 

1:, aHE-^ h-^^etetHtly.! a^ia qtilcR atopS; emergency prccedure89 
auco--*nuIaxed f''t iandinv-^s, in;i huraau laccorSn 

J . AI4E-iO Enier^,ci?:v pcOvHd'^j.cSp human tacLor's^, helicopter 
limit :ns ^ tind ^^ceep appia;^i:.h and maxamuiu cake-off o 

k aMI'mIc TriKe-;;ff, land gtoand, deceleration and quick 
stopH, ^r-ro ..r.tif fjVinboLfe, 0:10. c'lstttnca acid ctixectiono 

AHK-I2r. Iv^iads cilotL, wiad direction and speed, variation 
and deviation, and a navi gat l^r^al pxactical exerciseo 

TFi /^^^E ; ?o Llf^ uL-e oi che aavi^> tnti on coiaputeto* 

n. AME-!ho Fxi.q.hf, plans j a navigational practical exercise^ 
density altitude^ adverse v/eanher^. pe i:f otmance data chnrts^. low level 
navigation^ and slopes and confined ateaso 

Or, A>iE-I5-> Mountain ;2ir^ Jiarion,, pinnaele approaches, fog^ 
icings tbunderst and terminal and bitea focecastSo 

Po AllE-i& The weacher depicticn chart^^ human factors^ radar 
suimnary charts, a weacher flfight planning practical exercisaj^ aircraft 
accident prevencloa, a-:iminiijtrative responsibilities., and aircraft accident 
inves tlpation: 
q, aME-17, Ajr laasti wedthet :}n Southeast Asia, weight and balance^ 
and visual seax :b 

Tlie Alrm-jiTi,^hip F^:a,Tli:l^Jtlcni listed above ate administered to both 
otixcers and l^OC^., Ihf-: j^coce? -dca ::oIlecteci rrom academic exarninatlon 
printouts far (t9 -i^^i^e.^ and trcm IBM punched cards for FY 70 classeso 

2n Way ant JJi'il :ec pr.ve i -'jjruc-nt Examin^jl ona-f. 'Ihese exami.natione 
are designed to r^e^t xh^>z ^ruaeat s proi'^re'is^ in aequiting knox\rledge of 
milltajty subjects, Tbpy include.^ 

a.. Warrant Officer Development Examination (WDE)«'lo The 
organization of the Army 

b- WDE-=-2,. Prv.l}'t^n .s,^jving and unit progr^ant^o 

id - ' 
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WDE-S Leadership 

d. Pay and allowances , checking accounts, budgets and 
savings, and survivor * s benefits ■ 

e. Vn3E-5. Unit adminisrracion and military justiceo 

f / WDE-6, Uniforms, the Honor Code, intelligence, safeguarding 
defense informacion, r?.nd customs and courtesies- 

g WDE-7. Map symbr ' 5 and marginal information, location and 
coordinates, and distance and map scales 

h^ WDE-8 Terrain features, elevation, directions, azimuth 
plotting, intersections, resections, and polar coordinates. • 

1 WDR~9 Aerial photography and military symbols c 

j WDE-IO. Internal defense and development, and command and 
staff subjects. 

k. WDE-II Effective writing I 
1 WDE-i2. Effective writing II- 

m. WDE-13 , The Officer Efficiency Report, mess and sanitation, 
personnel action, and nuclear effects,. 

n. I^E-IA Military instruction and unit supply. 

3 . Officer Development Exa minations (ODE ) ,. These examinations are 
given in"^RWAC^ Officer students originally took iO tests with content 
virtually identical to TOE examinations, but the mmber has now been 
reduced to three t 

a- ODE-I Map readings 

b ODE-9 Effective writinp. 

c. ODE-IO Effective writing.- 

4, Development examinations also have maxima of 20 points with a 
passing score of 14. Data are derived from academic printouts for FY 
69 classes and from IBM punched cards for FY 70 classes- 

Letter grades for completed dual flights are compiled and recorded 
from a cumulative computer-printed listing prepared by USAPHS. Letter 
grades are awarded on a four-point scale and recorded in descending 
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ordei of quail cy or pertoxmance as Above Average (Aa) , Average (A), 
Below Average (BA) , and Unsatasf accory (UJ . There are approximately 
75 graded flights ac Fort Wolters,, (Also compiled as a matter of 
convenience for Jruture analysis bat not for inclusion in original 
matrices are the identification number of the instructor pilot on the 
rllghti the identification number of the lesson, which in turn will 
allow detemmatlon of the ins trucrionai content; and the time of day 
duclng which the flight occurred.) 

Fur advanced training grades on comple.ted dual flights are recorded 

ln.ltTJ''"TT^:. Advanced lnscrumenf, and Translticra training EtageOo 

In addition, checkride grades for each stage of traininp are recorded^ 
Ihese grades are manually transcribed from original hand-^written records 
made by flight instructors.. 

« bl'i^. ^H^Mt WORWAC, .Ph.asjJ[II^^c^Phase_II_acadeinic grades „ 

All Fort Rucker academic examinations are graded on a per cent correct 
basis « 

i'or those students who receive advanced flight training at Fort 
Rucker. scores on the toliowlng academic tests are recorded? 

a, RWC'l.. Basic instruments (aDF, OMNI, RMI) and basic 

flight 



landing 



be RWC-2. Flight regulations (Radar and ATC) and instrument 



Co Fl-r-l,, Fixed Wing tactical flight procedures and the 
dead reckoning computer- 

d m~2.^ Fixed Wing IFR flying and navlgationo 
c DOMT-1 UH-1 Siyscems ^nd maintenance. 

^ - i.-^'^- ^'^^tJd^}^i^9.I\'^^^^L2zJl^j£__ PhabeJ^U academic ^jrades„ 

Scores on the ruilowing e;:amiaaclons during this phase of training 
will be recorded. 

a TAC'l , Communications and flares 

b TaC--2 Gunnery 

c. TAC-3 General subjectSr 

d, rAC-4,. LKperience in escape and evasion, 
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e TAC--6. Aircraft gunnery. 

f TAG-? ArciLLcry subjects 
Fort Rucker academic grades are on a per cent scale, 
i^H^-'^-^i-:§^?5^^^-S-™ALPi^ase^^^ 

StJ.lr attend advanced flight training at Fort Hunter- 

SLewart, the following academic grades will be recorded: 

dead'reckoninr"' '"^'^^""^"^^ operation. VFR, IFR, traffic control, . 
instrument landings-""' navigation aids, radar and . 

c AHT-3 FAA procedures, charts, navigation aids, 

d. AHT-4.. Maps, weather-, 

e .AHT.^5 Powerplant, weight and balance, maintenance records. 

f AHT~6„ Fuel and oil systems, ro'ior systems, tracking' 

vent"aMn/'%'T; '^'^"^ ^^^^^^ ^^^^^^^ > h^atx'g ' 

ventiiat-mg and defrosning systems. 

a. TAC~i Communications and flares 

b. TAG -2. Loads and gunnery, 

ATC, medieval)''' "-^'^'^'^ ^^^^^^ ' operations, 

d, TAC-4 Survival, escap- and evasion. 

e. TAC-6, Tactical flight missions 
f- TAG- 7 Artillery 
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Section 2 



RATIONALE FOR INCLUSION OF VARIABLES IN THE STUDY 

Variables are considered in the same order as in the Section 1 
listing. 

A.> Identification variables . 

Variables Al (Class number), A2 (Class roster number), and A3 (Social 
Security number) serve as individual identifiers for the purposes of 
modification and expansion of subject files« 

^ * Dgniographic and bio g raphical variables , 

1' P rocurement source . Two studies published by the Naval Aero- 
medical Institute have shown the relation between procurement source and 
amount and type of attrition in Naval aviation training (2j 2).^ 
Wherry and Hutchins (2) found that the use of procurement sources in 
dichotomized form in the computation of the multiple prediction formulae 
used to predict success in Naval flight training resulted in increases in 
the validity of the formulae for both officers and non-officers. In our 
initial matrices fcr WOCs, procurement source is a dichotomous predictor 
variable- The two categories are EG and IS. For comparison of accuracy 
of prediction, separate matrices will also be computed at each point in 
training for EO and IS candidates. In these matrices, of course, pro- 
curement source will not appear as a variableo 

Procurement source for officers will indicate the source of the 
officer commission. These sources are (1) direct, (2) academy, (3) 
OCS, and C^) ROTC:> During analysis, procurement sources will be treated 
as if they were four separate dichotomous variables. An individual will 
receive a score of one on the variable which describes his procurement 
most accurately and a zero on each of the other four variables. This 
dichotomizing procedure, described previously by Bottenberg and Christal 
(2) and Wherry, Jr. (^), will be used with several categorical variables 
and will be referred to hereafter as the pseudovariable technique (4). 

^* ^ number of studies have shown correlations between rank 

upon entry to flying training programs, and performance in those programs 

^> In the study which established the FAST battery for primary 

selection, rank was negatively related to flight grades, but positively 
related to leadership evaluations (5), In that study, it was concluded 
that this variable and age would be ineffective selector variables because 
of their reversal across these criteria. In general, younger, and lower 
ranking students tended to be better pilots, while older students were 
more often better leaders. Since the Army wishes to train people who are 
both good leaders and good fliers, a restrictive policy on these variables 
would lead to an increase on one performance measure but a decrease on 
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another. However, in secondary selection, it is possible to take 
advantage of these differential relationships. That is, one can consider 
students against flying criteria after they have completed the leadership 
portion of the course. 

In a 1964 study Hutchins found that rank was a valid predictor 
variable for Naval aviation training (6) . Officers in pay grade 0-1 had 
a significantly lower rate of attrition than officers in higher rank. 
Also, higher ranking officers attrited more often by means of the DOR 
(Dropped on Request) categor> In the present Army situation, self- 
initiated elimination, which is comparable to the Navy^s DOR category, is 
one of the major attrition problems. Therefore, rank will be included in 
the initial matrices for both WOCs and officers. 

related in paragraph 32 , age has previously been shown 
to relate to multiple criteria in the Ajtmly training program ±tt a con- 
flicting manner, so that older students as a group are rated higher during 
pref light, but lower during flight training. However, the present sample 
is much younger than that for the earlier Army study. A decrease in 
flying performance with age is less likely in a younger population. 
Especially among EO candidates, where there will be no variation in rank, 
age is seen as potential contributing variable in predicting performance. 

4. Branch . This variable is applicable only "to officer trainees, 
who are assigned to the aviation training program by their branch head- 
quarters « Different selection methods used by the various branches 
may result in differential probabilities of success in the program for 
those selected. Branch will be treated by the pseudovariable technique. 

3n Previous flight training . This variable was shown to be related 
to several criteria in the Kaplan study (5) . The correlation with pass/ 
fail during the flying portion of the program was substantial.. This will 
also be treated as a pseudovariablec 

6. Marital status ^ In a number of cases, wife's attitude has been 
cited as the reason for withdrawal from training by candidates wishing to 
leave the program by means of self-initiated elimination. It seems 
logical, therefore, that marital status could be a predictor of this type 
of attrition from the program, 

7. Educational level . Kaplan (5) found low correlations between 
educational level and various criteria within the training program. In 
general, the correlations were positive with academic performance and 
negative with flight and leadership performance. 

8o Months of prior service . This variable will be highly correlated 
with the rank variable in the case of both officers and WOCs. While it 
is unlikely that both rank and prior service will be useful, the question 
of which is more useful must be empirically resolved. 
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9 Numbe r ot dfepcndents This variable also can be expected to 
correlate highly with age, tank and marital status, but the initial 
problem is to distinguish which one or combination these will contri- 
bute most to prediction of pe/:f ormanc 

Actions «. 

~" Progress categories . This is a statement of management actions 
taken on students as they progress through the program. Perhaps the most 
Important of these is the setback for training deficiency, which may be 
either flight or academic. Other reasons for setbacks are medical holds, 
administrative holds, emergency leav^es, lack of motivation, disciplinary 
problenis, and unsatisf actox,y military progress, 

^ XQ c^ti w of advanced Oight training . This variable reflects the 
location of advanced rotary wing training, ^ World War .II research in, pilot 
training showed clearly that standards among flight school locations can 
vary enough so that equations which are .valid for one location will be 
useless for another C^) , 

^ " I^re training information , 

1" FAST c omposif.e score . In order ^o. qualify for flight training, 
an applicant must score a minimum of 250 points on the warrant officer 
rotary wing FAST battery or 155 points on the officer rotary wing FAST 
battery. A previous study of the ability of the FAST to further dis- 
criminate among men who qualify for training has shown- that it is a 
strong predictor of flight deficiency elimination among the students 
selected (5) . 

AFQT score^ ^^ile this is not a variable directly applicable to 
selection for the aviation program, a minimum score of 31 on this test is 
necessary for entrance into the Regular Army as an enlisted man^ It is a 
basic cognitive aptitude test of a type which has been shown to be valid 
in the Navy^s aviation training program and the World War II Army Air. Corps 
program^ Cognitive tests have been strong predictors of academic per- 
formance in WORWAC (5) , 

GT score . In the FAST validation study (5), this cognitive score, 
derived from the arithmetic reasoning and verbal scores of the Army 
Classification Battery, had the highest single correlation with academic 
performance* of all measures investigated. It is a measure of general 
cognitive ability of the sort that has been shown to be valid for pre- 
dicting performance m almost any situation in which academic scores are 
a components 

E Primary academic variables , 

The Navy program academic grades which have been shown to be related 
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to probability of completion oi the Navy flight training course are: 
mathematics, physics, navigation^, engineering, aerodynamics, and 
physiology (9) , The Army aviation examination program is not divided 
in terms of classic technical or academic subject matter areas, but 
similar subject matter is'' identifiable at various points in the Airman- 
ship Examination series. PREDICT will statistically evaluate the 
relations of all Army academic examinations to training success. The 
Warrant Officer and Officer Development Examinations (which test develop- 
ment of military knowledge) are obtained from the same data sources as 
the Airmanship Examinations. Thus there is little additional cost in 
including these examinations in the initial matrices. Examples of 
Navy-Army academic program similarities follow, along with statements 
of the relationships between performance of Navy student pilots in the 
various content areas and criteria of success in the Navy program: 



Navy Point-biserial 
Correlations 

Army Examinations Navy Content Area with Complete/Attrite 



AME- 


-1 


Aerodynamics 


Non-officers 


.144 








Officers 


.151 


AME 


2 and 3 


Engineering 


Non-officers 


.124 








Officers 


.168 


AME 


4, 5, 6, 7, 


Physics 


Non-officers 


,105 




12 , and 15 , 




Officers 






16, 17 . 


Math 


Non-officers 


.150 








Officers 


.122 


AME 


11, 13 and 14; 


Navigation 


Non-officers 


.162 


TOE 


7 and 8; 




Officers 


.147 



RWC-1, RWC-2 

F. Fort Wolters flight grades . 

The major source of attrition in the aviation program is failure to 
learn to fly the aircraft properly. Obviously, then, flight grades are 
job samples for the purpose of this study, and should form strong 
predictors throughout the program. In the Navy study, once flight grades 
are available, they become the strongest single predictor of future 
performance for non-officers and officers through the remainder of the 
training program, VJhile the average grade for the previous phase of " . 
flight is the strongest predictor in each case, for non-officers the 
flight grades from the presolo period are significant contributors to 
prediction for every subsequent phase of the program (9) » 
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The rationale for Fto Wolcers^ academics and flight grades also 
applies to variable classes G, Fto Rucker or Hunter-Stewart flight 
grades i H and I; Ft. Rucker academic grades; and J and Kp Hunter- 
Stewart aaademic grades o 
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Section 3 



MltTHOD OF DATA COIIECTION, CODING AND STORAGE 

Variables v;hose values were determined from sources not conveniently 
arranged for IBM card punching are entered by the Work Unit staff on a 
data foxm designated the PREDICT Individual Data Record (PIDR) . A copy 
of the PIDR and detailed instructions for its completion (which include 
coding) are attached as Appendix 1. As the data collection system 
evolved, increasing automation ci the collection and storage process 
was achieved. Originally, for Indtance, significant portions of the 
identification, demographic, biogt.^pbical and pretraining information 
listed in pat ts A, B, ar)d D of Section 1 of this document were found to 
be missing on the USAPHS IDP . In most cases, lack of entry was in turn 
due to the fact that Form 20 information for WOCs and Form 66 information 
for officers had not been properly entered ^ It was found that effective 
monitoring of propex entry of a variable most often depended on the 
frequency of i rs use by agencies handling personnel records subsequent 
to handling by tht::- agency responsible for entry. For several variables, 
little or no subsequent use was evident. Accordingly, data were fre- 
quently missing- As notice of monitoring and impending use was given to 
responsible agencies, record keeping quality substantially improved. 

Most doci-ment? in the system are organized by class rather than 
individual, Sioce PP.EDICT data files must be organized by individual 
and include variables from a number of documents organized by class, it 
was more efficient tu transcribe the data from these class documents to 
a PIDR for each student. For FY 70 classes beginning with 70-9, IBM cards 
used to generate the class documents were obtained and shipped directly to 
the HumRRO Computer Center rilCC) , precluding clerical entry onto PIDRs. 

USAPHS flight grades were originally obtained from computer printouts 
which are a permanent part of a student's training records. These are 
amenable to card punching without transcription to the PIDR, but they 
require some clerical modification. Again, beginning with early FY 70 
Glasses, arrangements were made for obtaining the IBM cards from which 
these printouts were generated, thus eliminating repunching. 

At presenc, all data for original matrices is flowing automatically 
from USAPHS to HCC. Data of BCT performance are not now being collected 
but ceinstitutlon will be immediate if these data for USAPHS classes 70-1 
through 70-23 show significant potential for predicting the performance 
of EO personnel. 

Monitoring the completeness of automatically transmitted data will be 
a computer function. For back-up purposes, manual collection of data 
will continue until computer-generated completeness records are available. 
As necessary, manually collected data will be transferred to PIDRs to 
supplement routinely transmitted data. Manual transcription of data will 
thus occur by exception rather than routinely. 
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Appendix 2 contains the Master Data Control Form (MDCF) giving 
current information on sources of PREDICT data, showing responsible 
agencies, job titles of responsible individuals within agencies, names 
of incumbents in those jobs, and ETS for the incumbents • Where the ETS 
is indefinite, the monitoring schedule for maintaining contact with the 
incumbent is shown. Turnover of responsibility and job incumbents 
occurs frequently, The MDCF is revised upon every change of agency, 
job fitle, or incumbent involved. Copies are maintained at HumRRO 
Division No 6, at the Office of the Special Assistant for Information 
and Data Systems ^SAIDS) at USAPHS, and at HCC« 

Appendix 3 reflerts the current state of data completeness for 
manually compiled variables for the classes of the original sample- For 
the purposes of initial analysis, values of missing data for a specific 
variable will be estimat-ed by the method outlined in Section 4, 
CoD^-mviPg efforts will be made to fill empty cells with actual data by 
varicus tracing means. 

Appendix U contains a summary of methods used to trace data not 
available from primary sources, including lists of alternate sources, 
addresses of agencies responsible for alternate sources, job titles and 
incumbents for staff contacts within those agencies where applicable, 
mearis of collection used for each alternate source, and specimen copies 
of da^a collection forms. 

^#ien.a de^-ermination is made that a datum is irretrievable, HCC is 
notified that the estimate used will not be replaced at a later date. 
If da^a for a class or classes are determined to be unusable because of 
missing data, the data bank will contain a detailed explanation for the 
lack of information on those classes. Because of accidental destruction 
of academic performance data at USAPHS, FY 69 classes 31 through 44 will 
not be included. However, data are already available for card punching 
on a sufficient of FY 69 students in all pertinent categories to 
al].ow generation and validation of equations. 
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Sectrion 4 



METHOD OF ANALYSIS 

The approach to prediction used in PREDICT I will be that of multiple 
regression equations derived from multiple correlation matrices. The 
multiple correlation aad regression situation is one in which we have a 
criterion variable, also called the dependent variable, whose value or 
values for individuals are to be predicted, and two or more predictor 
variables, also referred to as independent variables.- In addition, we 
have an experimental sample. In the classic psychometric model, this 
experimental sample is a random sample of a defined population. Often, 
however, as is the case with the experimental sample for PREDICT, the 
sample is not a random sample from a population. In our case the popu- 
lation is defined by the sample. The population consists of the set of 
all individuals "like" those in the sample; i.e., the set of all indi- 
vidu.als who might have been selected for this sample by the same 
selec:-ion procedure. Our experimental sample consists of all personncil 
going ^.hrough the training system in classes^'-69-05 through 69-30. \^en 
we use these data to predict the performance of individuals in later 
classes, we will be making the assumption .that the variable-to-performance 
relationships for students in the new classes will be substantially 
similar to the set of relationships which were obtained among the ones we 
measured^ This, of course, will' not be left as an assumption any; longer 
than necessary. The system will continually test the assumption against 
the performance of new individuals, and change the equations as necessary. 
Since large numbers of individuals will be involved in the development of 
the first set of regression equations, it is expected that the prediction 
formulae will remain relatively stable^ 

For the members of the experimental sample, the first -dependent 
variable studied will be completion or failure to complete the training 
program. The predictor or independent variables will be those listed in 
previous paragraphs. Performance in the gunnery training program will 
then be studied as a dependent variable with the same set of predictors 
used in the first study. 

Dependent or criterion variables to be studied' in later phases of 
PREDICT will include numerical grades awarded at the end of each phase of 
training, and final academic flight and overall grades. 

For the first analysis, we have the following prediction situation: 
represents the value of the criterion variable, and X y X y ...^ Z 
are predictor variables. The purpose of a multiple regression analysis 
is to formulate an equation relating y as precisely as possible to 
X^y X^.y eo-^ X^y using the data from t^e experimental sample. Using thia 
equation, values of y ^ for students who were not in the experimental 
sample, and whose actual y scores are unknown, \<j±ll be predicted. Also, 
we will assess evvoTS of predictioriy which are the differences between 
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the predicted ;y ^ scures and the actual y scores of the individuals 
predicted, ThivS will tell us how much con '.dence can be placed in the 
prediction. Consider y^^ a score based on the values of ...^ AT . 

being used to predict an actual criterion score y . For individual 
students, the error of prediction is the difference y - y . In the 
multiple linear regression equation, which we will use in S?REDICT I» we 
will be making use of the following linear equation: 

This is a raw score regression equation, &p Z? ^ & are partial 

regres.sion coefficients, and C is a constant, y ^ then,^is predicted 
from which is in turn based on X X,,^ ,^ ? , It is a linear 
estimafe, i-e. , a weighted sum of the Zs^'plus the^constant, the bs 
symbolizing the values of the weights, y is then a weighted linear 
composite ot the X& plus the constant. Equation (1) is so valued as to 
constitute the best possible linear approximation of all the individual 
equations % ^ ^ b .X ^fb ^X^± . . ,b^X -fC . These equations, one of which exists 
for each ifidi^/idual in ^he sample, are usually inconsistent in that no 
single set of values given b^^b^^ b and C will satisfy ali of them. 

The phrase "best possible approximation,^ is defined in terms of 
classical least-squares ' theory : values of the bs ?.nd the constant are to 
be chosen so as to minimize the sum of squares of the differences between 
the N pairs of values of and y . In other words, Z(y ^ y )^ = min. 
Completing this process also resuSts in the maximization^of r^C^ which is 
the correlation between the weighted composites of the Xs and^the actual 
observed value of j/^. v^C is called the coefficient of multiple corre- 
lation. Its value varies from zero to one, and its relative size is a 
statement of the closeness of the approximation of the y to the y . 
Restated, this value tells us how well the y can be predicted from 
knowledge of the values of the Xs which make'^up the approximation equation. 
The minimization values of the bs and the constant are obtained by 
determining a solution to a set of m normal equations in m unknowns. Once 
these values have been determined, a value of y^ for each individual is 
computed from the resulting equation by substituciono 

An assumption implicit in the use of this method is that the errors 
are random. This implies that all subjects making up the distribution 
are equally predictable, and a deviation from the best fit straight line 
is due ^o errors of measurement. Although it can readily be shown that 
this aS3un»ption is often not met (20.^ llj^ it has been the experience of 
those working with large numbers of subjects and comparatively few 
variables, chat more complex curves are not useful at A^s of less than 
10,000 '^^K 

Differential predictability will be explored in PREDICT by the use 
of logically derived subgroups. For example, it is quite reasonable to 
expect that WOC EO personnel who come into the aviation program directly 
from civilian life could differ in many ways from those personnel coming 
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into the program from an in-service active duty status. Therefore, 
separate in tercorrelation matrices will be computed for these groups and 
the predictions derived from their regression equations will be compared. 
If the predictions differ significantly, separate tables for prediction 
of performance of these groups will be furnished training managers. If, 
however, no significant increase in predictability is obtained by con- 
sidering the two groups separately, a single set of tables for the 
prediction of WOC performance will be used. Because officer students 
receive slightly different training in terms of academic and military 
knowledge tests, separate matrices will be computed for them. The signi- 
ficance of differences between predictions will be tested by means of 
contingency tests of goodness of predictions in categories. 

Equations for each possible combination of valid predictor variables 
will be computed at several points in training. The first matrix for 
•enlistment option candidates will be composed of primary selection, 
demographic, and biographical variables and will be computable at the 
beginning of Ft. Wolters' training. The next matrix will consist of these 
variables plus academic performance during the first two weeks of pref light. 
This matrix is necessary to attempt to relate early academic performance, 
demographic-biographic variables, and selection variables to the attrition 
by resignation which we experience in the last week of ' pref light . It was 
established during exploratory research that daily flight grades on the 
first five graded flights correlate well with later performance, -so the 
next matrix will consist of selection and training variables through the 
first five graded flights. Moving forward from that point, matrices will 
be computed for USAPHS training at the end of the presolo period, at -the 
end of the primary period, and at the end of the advanced period. Moving 
to Ft, Rucker and Hunter-Stewart, matrices will be computed at the end of 
the basic instrument phase, the advanced instrument phase, the transition 
phase, and the last phase at Ft. Rucker, which is tactics. Of course, 
Rucker academic grades, Wolters academic grades, and Hunter-Stewart 
academic grades will enter into these matrices as they become available. 

Since an equation will be constructed for each possible combination of 
valid predictor variables at each point, the system will allow for 
immediate substitution of a new equation at any time that modification of 
the training program renders one or more variables no longer pertinent. 
The .principal modification which would necessitate a change of equations 
would be the discontinuance of a particular measure. 

There are a number of cautions to be considered in the use of the 
multiple correlation technique and multiple regression equations, but 
the majority of these are matters of interpreting results, rather than 
of the practicality of using weighted scores for predicting perfomance . 
Continued monitoring of the predictive utility of this system and 
empirical comparison of its precision with those of alternative decision 
methods will be the proper tests of its usefulness. Its proper mainte- 
nance, of course, will require prompt communication of changes in the 
content or sequencing of the program of instruction to those responsible 
for providing the equations to their users. 

O 113 . • 

ERIC lit 



The inltia.J .^naly^^is of da^a will be accomplished by use of the 
HumRRO generalirevi roiaputer program REGRS I. This is a step-wise multiple 
linear regression program described in detail in the User\s Manual for the 
HumRRO statisti-il analysis system. Since REGRS I does not account for 
missing dafa, the following preliminary steps will be taken; 

Ic No variable will be. used in analysis unless its value is known 
for at least 90 per cent of the sample. 

?, Rt>^ ;teir;sior vvjuaf: ioni> wiU be computed from zhe data of all 
those stu^^ev^s whose d^t.^ -jte t-nr.ple'^e for all predictor variables, with 
each p>^ed'ctor v:iriaDle .tuu ''essivei v in, the dependent variable positionp 



missing 



3 Scares :erivr2d from these equations will be inserted in 
data cells lex tun^ variable. 
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GENERATION AND IMPLEMENTATION OF INITIAL. PREDICTION EQUATIONS 

When all cells have been completed for all variables, REGRS I will be 
applied with the dichotomy complete/attrite as the dependent variable. 
The regression equations generated will be applied to each individual in 
the sample and the resulting predictor scores used to generate the graphs 
and tables illustrated in Appendix 5. The materials illustrated will be 
compiled in a nol;ebook for distribution to the agencies designated by the 
Commandant of USAPHS and USAAVNS to be responsible for computing predictor 
scores and thus serving as Student Prediction Centers (SPC) . 

It will be necessary that the schools involved program their data 
management systems so that the SPCs have immediate access to the selection 
and training records of all initial entry students in residence. It will 
be especially important that all agencies involved ensure that the selection 
and .training data are complete for all students, as required by the 
pertinent ARs, 

Upon authorized request, an SPC will compute and furnish predictor 
scores of students in difficulty. 

Once the regression equations are established, they will be updated 
at quarterly intervals by recomputing from the data base generated by: 
(1) adding those classes graduated since the last computations, and (2) 
dropping the data from those classes which graduated in the oldest 
quarter of the previous computation. The equations will be revised if 
significant differences arise. If the first quarterly updating procedure 
shows the equations to be unstable, updating will be performed at shorter 
intervals until an optimal interval is found. If, on the other hand, the 
equations are found to be extremely stable on quarterly updating, the 
updating interval may be appropriately lengthened. 

It should be noted that it is highly unlikely that all the variables 
tested will enter the regression equations used to generate predictor 
scores. Typically, it is found that the proper combination of a few 
variables from the original set tested will predict for practical 
purposes, as well as a more cumbersome equation using all variables 
correlated with the criterion^ For example, in the original Navy system 
for non-officers, the regression equations used three variables from 
eight examined for the first two weeks of training, and seven variables 
from 18 examined for the last stage of training. 
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Section 6 

ADDITION OF VARIABLES TO THE SYSTEM 

^ ^ jAsA^,,. ^>otnbat training performance of EO trainees , 

Beginning with class ?0-l, scores on the following measures were 
collected for flight ttaining EO trainees at Ft. Polk, Louisiana. 

1' Physical Combat Proficiency Test 

2. Basic Combat Training Tests 

? Coinmander ^ s Evaluat j on 
Weapons Qualification 

5. ACB Sub- tests 

6. Officer Candidate Test 

7. Driver Aptitude Battery 

8. Army' Language Aptitude Test 

9. Officer Qualification Inventory 

Foi^ USAPHS classes 70^1 through 70-23, the multiple correlattdn* . 
between predictor variables and .Che completion/attrition* dichotomy will 
be computed excluding these additional data and then including them. If 
a significant improvement in the size of the multiple R is obtained by 
including these new variables, the prediction equations then in use will 
be modified to include scores on those variables*, 

These data will also fae urilized in an attempt to predict "Snobird" 
artrition. Snobirds are those WOCs who have reported to USAPHS 
for flight training but who have not yet begun preflight. At present, 
the number of Snobirds awaiting assignment to training exceeds 400. 
Attrition by resignation has been high in this group, 

^ • Addition of scores f ro m the Background Activities Inventory, 
Situational Confidence Measures, the Officer Student Biographical Data 
Form, and Contemporary Evaluation Ratings . 

The preceding sections have dealt with data generated by the Army 
aviator selection and training system. In addition to these data, PREDICT I 
will deal with experimental measures designed to provide types of predictor 
information not presently generated by the system. 

The Background Activities Inventory and Situational Confidence Measures 
were originally derived from research done by HumRRO Division No. 3 under 
Work Unit FIGHTER. They were originally described in HumRRO Technical 
Report 66-12- Descriptions of their modification for use in the aviation 
training system can be found in several recent HumRilO Professional Papers 
(8j 13j 14), These instruments are now being subjected to item analysis, 
and the refined versions will be cross-validated against FY 69 classes of 
officers and WOCs. Indications from preliminary research (8^.12) are that 
these indices will add to predictive validity. 
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^ r^™o Student Biographical Data Form was used by both USAAVNS 

and USAPHS for collection of data on aviator trainees during recent 
years. At the recommendation of the PREDICT staff, the Form is now 
undergoing item analysis. A revised form will be validated, also against 
FY 69 classes, and if it is found to contribute to prediction, a recom- 
mendation for its reinstitution will be made to USAPHS and USAATOS . 

Contemporary Evaluation Ratings, a form of peer rating, have been 
^?f^^;S'7n^^^^ collected on WOCs by the Troop Brigade at USAPHS beginning 
with FY 70 class 70-5. Because the current ratings contain only rankings 
With no scaling against absolute standards, the PREDICT staff has 
conducted experimental administrations of alternative forms providing for 
absolute scaling (and also testing for the effects of assurance of 

^SAA™j'^^''^'^"°^ ^^^^^^^^ beginning with class 70-23, and at 

UbAAVNS, with class 70-5. 

Peer ratings have been shown to add predicuxve validity to the Navy 
system for both training (9) and Operational (15) performance. They have 
also proved valid in Army performance prediction (16). , It is 
expected that FY classes 70-5 through 70-13 will furnish sufficient data 
for experimental determination of the potential contribution of current 
peer rating forms to 'the PREDICT matrices and classes 70-23 through 70-31 
will furnish data for evaluation of the experimental forms. 

C. Addition of summary flight evaluations . 

The initial matrices will use means of accumulated daily flight 
grades as predictors. 

Checkride grades at Hunter-Stewart and Ft. Rucker are also being 
added to the data bank for eventual evaluation but will not be included 
in the initial matrices. USAPHS checkride grades have been shown in" 
exploratory analyses to be significantly inferior to daily grades as 
predictors of the complete/attrite dichotomy. 
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SELECTION OF STUDENTS FOR HELICOPTER GUNNERY TRAINING 

Two ^iindices of quality of performance in helicopter gunnery training 
are currently available in quantitative form. These are the Weapons 
Qualification average grade and t,he Attack Helicopter Tactical Employment 
grade which respectively reflect performance in actual firing of weapon 
systems and in proper tactical employment of the aircraft. These can be 
used to select students to maximi7.e training performance. In addition, a 
third index of quality can easily be quantified. This is the training 
data profile of those returned aviators who have completed a combat'tour 
as armed helicopter pilots. This measure may be further refined by use 
of a peer rating system which would select from these returned aviators 
Chose who are considered most successful by their contemporariesc Another 
refinement now in progress involves study of the performance in initial 
training of those aviators rated poorest by their peers on the Combat 
Rating Scale described in HumRRO Professional Paper 34-69 (17). Aviators 
from USAPHS class 69-5 will begin returning from Vietnam assignments in 
appreciable numbers durijag the fourth quarter of...FY 70. At that time, 
ratings of combat performance for subjects for whom full-scale PREDICT 
data are available will be possible. 

In February 1970, the PREDICT staff began conferences with personnel 
of the Aviation Armaments Division, Department of Tactics, aimed at 
selecting criteria for definition of the' successful armed helicopter 
pilot. Regression equations against all available criteria will be 
computed with HumRRO furnishing information on their relative soundness. 
Decisions regarding the criterion (or composite) to be used for selection 
must be left to the Army. 
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Appendix 1 



Codes for PREDICT Individual Data Record for 
WORWAC/ORWAC Classes 

1, Card 1: Identification card . 

cc 1 - 4: Ft. Wolters or setback flight classes. Fiscal year 
(cc 1 & 2) and class number (cc 3 & 4) , Odd class numbers designate 
warrant officer trainees; even numbered classes designate in-service 
warrants and commissioned officers. For an explanation of "setback 
class," se^ description of cc 25 - 28 for Card 6. 

cc 5 - 7: Ft. Wolters or setback class roster number. The 
number assigned' to a man within a flight class. This number changes from 
Ft. Wolters to Ft, Rucker (or Hunter-Stewart) and with Ft. Wolters, Rucker 
or Hunter-Stewart when a person is set back-to another class . Ft. Wolters 
roster number codes are as follows: 

1, 1 - 299: Warrant officer candidate rotary wing initial 
entry (WORWAC) 

2. 401 - 499: Warrant Officer candidate rotary wing 

setback 



3. 601 - 799: U.S. Officer initial entry 

4. 901 ~ 999: U.S. Officer setback 

cc 8 - 13: The date the Ft. Wolters flight class started, 

cc 14 - 22: Social Security number. 

cc 23-24: Rank. For WORWACs, rank is coded by the letter "E" 

(cc 23) followed by the appropriate numeral. Rank designated would be 

rank of the student prior to his enrollment in the flight training pro[^ran. 

For ORWACs, rank is coded as follows: 



01 
02 
03 
04 
05 
06 



2LT 
ILT 
CPT 
MAJ 
LTC 
COL 



For WORWACs, the codes are: 



W1=W0-1 
W2=CWO-2 
W3=CWO-3 
W4=CWO-4 
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cc 25-26: Age. The student's age as of his last birthday 
before entering flight schools 



cc. 27 - 28: Months prior service. If student has 1-99 months 
prior service, these figures are entered. If student exceeds 99 months 
prior service, the following code Is used: 



Al 
A2 
A3 
A4 
A5 
A6 
A7 
A8 
A9 



100-105 months prior service 

106-110 

111-115 

116-120 

121-125 

126-130 

131-135 

136-140 

141-145 



The "A" codes will be stored in the computer as the rounded means of the 
range of months for each "A" code, e^g., Al = 103= 100+105 

2 

cc 29-30: Educational level. The number of years of civilian 
schooling successfully completed. 

cc 31: Prior flight training (T for training). 

0 - No prior flight experience 

1 - AROTC flight training - not completed 

2 - AROTC flight training - completed 

3 - Limited fixed wing, other than "1" 

4 - Fixed wing private license 

5 - Fixed wing commercial license 

6 - Limited rotary wing experience 

7 - Rotary wing private license 

8 - Ro^rary wing commercial license 

If both "4" and "5" apply, a "5" is entered. If both "7" and "8" apply, 
an "8" is entered. 

cc-32: Enlistment option or in service (omit for ORWAC) . 

1 - In service 

2 - Enlistment option 

CC.33, - 35: Flight Aptitude Selection Test (FAST) composite 
score, i,eT;"rotary wing score plus fixed wing score. For data management 
purposes, the limits for FAST composite for WORWACs are 250-519; for 
officers 155-519. 
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iin "^o ' General Technical score (GT) . Range restricted to 

110 to 152, For officers, these columns contain the three-digit procure- 
ment source code rather than GT score. The source document for cc 1 - 39 
card 1, has a column headed "G/T" for both officers and WOCs, but it was ' 
learned after data recording had begun that the columns contained 
different information. The procurement source codes are as follows: 

236 - U.S. military academy 

237 - OGS 

238 - Direct commission 

114 - 902 - College or university from which student received 
ROTC training (there is no overlap with previous 
. . three codes) 



cc 39: Number of dependents. Example: one wife and two' 
children coded "3." 

cc 40: Blank 



cc 41 - ^3: Armed Forces Qualification Test (AFQT) score. The 
limxts of the AFQT are 0-100. ORWACs do not have an AFQT therefore 
these columns are left blank for them. 

cc 44: Marital status. 



S - Single 
M - Married 
D - Divorced 



cc 45 - 46: Exposure score from the HumRRO experimental test ^ 
the Background Activities Inventory (BAI) . , ' 

cc 47 - 48: The raw (or unweighted) Confidence score, BAI. 
cc 49 - 50: The raw (or unweighted) Despair score, BAI. 
cc 51: Residence (r) . 
"During the first 16 years of your life did you live mostly : 

0. on a farm 

1. in the country, but not on a farm 

2. in a small to\m (less than 2,500 people) 

3. in a town (from 2,500 to 25,000) 

4. in a city (more than 25,000) 

5. military dependent 

6. frequent moves, not a military dependent" 
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cc 52: Part of country (p) , 

'*In what part of the country did you live most of the time before you 
were 16: 



0. New England~Me . , N.H., Mass,, R.I., Conn., Vt. 

1, Mid-Atlantic—N/Y- , N, J. , Pa. 

2.. East North Central—Ohio, Ind^, 111, Mich., Wis. 

3o West North Central— Iowa, Mo,, N.D., S.D., Nebr., 

4, South Atlantic—Del., Md. , Dist, of Col., Va., W. 
Ga^, Fla* 

5, East South Central — Ken., Tenn,, Ala., Miss,, Ark 
6 West South Central—Tex., Okla. 

7. Mountain— Mont , Wyo., Colo., N,M,, Ariz., Utah, Nev., Idaho 

8. Pacific— Wash. , Ore , Calif,, Alaska, Hawaii 
9- Outside the United States" 



Kan. 

Va. , N.C. , S .Co , 

, La. 



cc 53: Component (C) : ' ORWACs only. 

1 or A - Regular Army 

2 or C - USAR 

3 ot I - National Guard 
^ or J - U,S. Marine 

cc 5^: Training specialty (S) : ORWACs only. 



1 
2 
3 



} These notations appear on some FY 69 ORWAC cards. 
) Thus far, USAPHS data processing has been unable to 
decode them. Investigation is continuing. 



cc 55-56: Branch (Brh) : ORWACs only. 



IN 


- Infantry 


CE 


- Corps of Engineers 


FA 


- Field Artillery 


AI 


- Army Intelligence Service 


AD 


- Air Defense 


OD 


- Ordnance Corps 


AR 


- Armor 


TC 


- Transportation Corps 


SC 


- Signal Corps 


AG 


- Adjutant General Corps 


MS 


- Medical Service Corps 


FI 


- Finance 






AV 


- Aviation Warrant Officer 



cc 57 - 59: Quora Source (QS) : Included for ORWACs only. Quota 
Source is an alpha-numeric code used to identify the agency providing the 
quota for a student's attendance at a sen.'-ice school course of instruction. 
Codes appearing on the PIDR ai;e noted here. For a complete listing, see 
Appendix 1, AR 350-2, 



14B 
50K 
58A 



U.S. Army Officer 18P 
Marine Corps 36B 
Enlisted Option WOC 32B 



Allied students 
Others 

Flight surgeons 
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2c Card 2: Ft. Wolters academics. 



cc 1 - 4: Ft. Wolters or setback flight class. Repeated from 

Card 1. 

cc 5 - 7: Ft. Wolters or setback class roster number. Repeated 
from Card 1. 

cc 8 - 9: Maximum number of points (items) for each academic 
exam. On all exams to date this figure is "20." 

cc 10 - 43: Airmanship Examinations (AME) . Each AHE entry is the 
number of points (i.e., number of items answered correctly) obtained by 
the student for that exam. These points are not to be confused with 
*'grade" which is the number of points obtained divided by the maximum 
number of points and expressed as a percentage. 

Qc 4A - 63: Officer Development Examinations (ODE). ORWAC PIDR 

on ly . 

cc 44 - 71: Warrant Officer Development Examinations (WDE) . As 
with AME, WDEs and ODEs are expressed as points, not grade. WORWAC PIDR 
only* 

3. Card 3: Ft. Rucker Academics. 



cc 1 - 4: F.t, Wolters or setback flight class. 

cc 5 - 7:* Ft. Wolters or setback class roster number. 



cc 8: R (P.ucker) . Card 3 is only completed when the student 
receives his advanced training at Ft. Rucker rather than Ft. Stewart 
and Hunter Army Air Field, Ga. 

. cc 9 - 12: Ft. Rucker flight class. In all cases the flight 
class designation in these card columns will be the same as cc 1 - 4. 

cc 13 - 15: Ft. Rucker roster number. Will only be identical to 
Ft. Wolters roster number by coincidence. Student is given a new roster 
number upon his registration at Ft. Rucker. 

• cc 16 - 36: Ft, Rucker academics, WORWAC Phase III,. ORWAC Phase 
II. This phase includes Basic and Advanced Instruments training. The. 
entries in these columns are "grades" (i.e., the per cent of tbt.al .^points 
received)' and thus require three card columns since the maximum grade Is . 
100%. ^.V 

cc 37: Blank * ... ' > 
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cc 38 - 58: Ft, Rucker academics, WORWAC Phase IV, ORWAC Phase 
IIIo This phase includes transition to the UH-1 ("Huey") helicopter and 
tactics. Entries here are ^'grades'' as was the case for previous phases. 

4 . Card 4: Hunter-Stewart academics . 

cc 1 - 4: Ft. Welters or setback flight class. 

cc 5 - 7: Ft<, Wolters or setback class roster number. 

cc. 8: H (Hunter-Stewart). Card 4 is only completed when the 
student takes his advanced flight training at Hunter-Stewart. Approximately 
one- third of the graduates from Ft. Wolters take their advanced training at 
Hunter-Stewart, 

cc 9 - 12: Hunter-Stewart flight class number. 

cc 13-15: Hunter-Stewart, roster number. This number will be 
identical to the student's Ft„ Wolters roster number only by coincidence. 

16-39: Hunter-Stewart, WORWAC Phase III, ORWAC Phase II. 
Like Ft. Rucker, the phase at Hunter-Stewart consists of Basic and 
Advanced Instruments trainings Encries here are "grades.,*' i.e., per- 
centage of maximum points received. 

cc 40: Blank. 

cc 41 - 61: Hunter-Stewart, WORWAC Phase IV, ORWAC Phase III. 
Like Ft^ Rucker, this phase at Hunter-Stewart consists of transition to 
the UH-1 ("Huey") helicopter and tactics. Entries here are in terms of 
"grades." 

5 . Card 5: Rucker or Hunter-Stewart dally flight grades , 
cc 1 - 4: Ft. Wolters or setback flight class. 

cc 5 - 7: Ft, Wolters or setback class roster number. 

cc 8: R (Rucker) H (Hunter-Stewart) . 

An "R" or "H" is entered depending on where the student took his advanced 
training. 

cc 9 - 12: Rucker or Hunter-Stewart flight class. 

cc 13-15: Rucker or Hunter-Stewart roster number. 

cc 16-30: The first: 15 graded flights during the four weeks of 
Basic Instrument training. A solo flight, an ungraded flight, or an 



O • ^ 126 

EEIC ' 124 



incomplete flight are not included. A description of the contents of each 
graded flight is not possible, since each instructor pilot (IP) may cover 
different content areas during a given flight. The content areas covered 
by each IP and his student are noted on the student's flight insert, but 
vary too widely to be categorized. The entries for graded flights are as 
follows: 

A = Above average 
B = Average 
C = Below average 
U = Unsatisfactory 

cc 31: The column labeled "16" on the PREDICT Individual Data 
Record indicates whether the student was given additional training (1) 
after receiving a failing stage grade for Basic Instruments or (2) because 
he was an exceptionally proficient student who was put up: for his Basic 
Instrument checkride some time before the required 25 hours in Basic 
Instruments. The codes for this entry are: 

Y: Yes, he received additional training 

M: No, he did not receive additional training 

cc 32i "F" stands for ^ the number of Basic Instrument checkrides 
the student has failed. 

cc 33 - 34: Basic Instruments (BI) checkride grade. Usually 
this is a two-digit numerical grade, but it may also be a letter grade, 
"A," "B," "C," or "U." A man will get a letter grade only if he has 
failed at least one previous checkride (a single digit will appear in 
card column 32, card 5, to indicate how many checkrides the student 
failed). In computing the studant^s stage grade (arithmetic average 
of instructor grade and checkride grade), the latter grade, because it 
is a retake, is given a weight of 70. This happens no matter whether 
the letter grade is: A, B, or C. Thus when a letter grade appears 
for BI, AI, or A, it is stored in the computer as "70."% 

cc 35-49: The first 15 graded flights during the four weeks 
of Advanced Instrument training. Same code as for BI applies here: 

A = Above average 
B = Average 
C - Below average 
U = Unsatisfactory 

cc 50: "16": Did the student receive additional training while 
in Advanced Instruments? Code "Y" for yes, and "N" for no. 

cc 51: "F" stands for the number of Advanced Instrument progress 
checkrides the student has failed. 
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cc 52-53: The Advanced Instruments (AI) checkride grade. 
This is usually a two-digit grade, but may in some cases be a letter grade 
(A, B, C, U) 0 See explanation for letter grades -in cc 33 - 34 above. 

cc 54 - 68: The first 15 graded flights during the four weeks 
of transition training to the UH-1 ("Huey")- Same codes as for BI 
and AI apply here: 

A = Above average 
B - Average 
C = Below average 
U = Unsatisfactory 

cc 69: "16'' is used to record whether the student did ("Y'' for 
yes) or did not ("N" for no) receive additional training in transition, 

cc 70: "F" stands for the number of transition progress check- 
rides the student has failed, 

cc 71 ~ 72: The transition checkride grade, "A/' is usually a 
two-digit number, but like BI-,- and AI, may be in some cases a letter 
grade (A, B, C, U) . See explanation for letter grades in cc 33 - 34 above, 

6 , Card 6: Criterion card , 

cc 1 - 4: Ft*- Wolters or setback flight class, 

cc 5-7: Ft., Wolters or setback class roster number, 

cc 8: (Wolters) "R" (Rucker) "H" (Hunter-Stewart) 

This column is completed either when a man has been set back or eliminated 
from the program or when he completes advanced training at Ft, Rucker or 
Hunter-Stewart, The "W" indicates a Ftc Wolters setback, "R" or '^H" 
may indicate respectively Rucker or Hunter-Stewart setbacks (see cc 25 - 
28) or serve as indicators of graduation if ccs 25 - 28, card 6, are 
blanko 

cc 9 - 12: The flight class from which the setback, elimination, 
or graduation took place. The preceding column indicates whether this 
was at Wolters, Rucker, or Hunter-Stewart, 

cc 13 - 15: The student^s roster number in the class from which 
he was set back, eliminated, or graduated, 

cc 16: C (Criterion) 

1 = Eliminated 

2 = Setback 
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3 = Graduated 

4 = Administrative hold 

5 = Eliminated but reinstated in later class 

6 = Accelerated; set up to an earlier class 

cc 17 - 18: Reason (Rsn) for the setback, elimination, or 
administrative hold: (Note: Graduation does not get a "reason code.**) 

10 - flight deficiency 

20 - medical, sometimes used generally, sometimes specified as: 

21 - medical, psychological 

22 medical, fear of flying 
30 - resignation 

40 - academics 

50s - "attitudinal variables,** specified as: 

51 - lack of motivation 

52 - discipline 

53 - unsatisfactory military progress (or lack of 

military development) 
60 - accident 
70 - unknoim 

P.Os - miscellaneous actions, specified as: 

81 administrative 

82 - emergency leave 

83 - deceased 

90 - administrative hold 



cc 19-24: The date that the setback or elimination took place. 
Note: Date of graduation is not indicated. 

cc 25 - 28: Setback class. For those persons set back to.a later 
Ft. Wolters class, the new class is indicated in these card columns and 
also in cc 1 ~ 4 on a second PIDR. This second PIDR contains all the 
academics and flight grades the person generated as a member of the new 
class. For those persons setback at Ft, Rucker or at Kunter-.Stewar t , the 
procedure is essentially the same: A second PIDR is added containing 
the academic and flight data for the new class. However, cc 1 - 7 of 
the second PIDR are left blank; i.e., the man's new Rucker or Hunt^^r class 
is not indicated here. This procedure insures that the first seyen card 
columns on aU cards refer only to the man's identification number at 
Ft. Wolters. 

cc 29 - 31: The roster number the student received in his 
setback class . 
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Master Data Control Form 
PREDICT Data Sources 

Section I: Fort Wolters, Texas, Data from the 
U. S. Army Primary Helicopter School (USAPHS) 

A. Data mailed to PREDICT staff by USAPHS Student Records Control Branch 
(SRCB) . 

li Initial Data Printout 

2. initial Flight Roster 

3, Corrected Initial Flight Roster 

. 4, Monthly setback and elimination report 

5. Snobird rosrer " 

6. Snobird DF 

7. Weekly setback and elimination roster by Flight Division 

8. Preflight to finish recap 

9^ Daily Disposition of students roster 

10. Training Analysis Digest (TAD) 

a. Agency: USAPHS SRCB. 

b. Responsible individual, titlp.^ and ETS : Mrs. Shirley Vaul, 
Statistical Clerk; indefinite ETS « 

c. Contact schedule and method: Mrs* Vaul is contacted via AUTOVON 
(483-3413/3555/3597) on those occa sions when expected data do not arrive 
on time, when necesary for clarification of the data, or when supple- 
.mentary data are sought, 

d. Additional information: Packets of data are mailed by Mrs. Vaul 
at weekly intervals. Data which accrue during the week are mailed each 
Friday, and received by PREDICT staff on Monday. In addition, PREDICT 
staff visit SRCB once a month on the regular m.onthly Ft. Wolters visit. 
Other contacts in this office are: CPT Brian Bagnall, Assistant Division 
Chief, indefinite ETS, and ILT Jim Houston, Chief of the Statistical 
Branch, indefinite ETS. 
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B. Data: Fort Wolters attritee information, 

1, Agency: SRCB, 

2, Responsible individuals, title, and ETo : Mrs« Shirley Vaul and/or 
ILT Jim Houston, 

3- Method of data collection: Attritee data are xeroxed by PREDICT 
staff personnel during monthly visits to Fort Wolteis, 

4, Additional information: Individual attritees' data are stored in 
folders sent to SRCB by Mrs, Shirley Avdeef, secretary of the Student 
Evaluation Review Board (SERB), Mrs- Avdeef is i-esponsible for 
completeness of PREDICT data for each attritee. Her AUTOVON number is 
483-2679. 
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C, Data: Snobird information (from Form 20) 



Snobirds are those WOCs who have reported to Fort Wolters for flight 
training but who have not yet been placed on the roster of a training class. 
These data include name of Snobird eliminee, effective date of elimination, 
age, marital status, AFQT score, GT score, educational level, FAST composite 
and FAST R/W scores. 

1. Agency: Student Personnel Office. 

1. Responsible individual, title, and ETS: Mrs. Susie Leatherwood, 
clerk, indefinite ETS. 

3. Contact schedule and method: Monthly visits or AUTOVON calls 
(483-3347/3193). 

4. Additional information: Snobird data collected during monthly 
visits or via mail upon AUTOVON request to Mrs. Leatherwood. 
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D. Data: Personnel, academic, and flight information. 

1. Agency: Data Processing Division. 

2, Responsible individual, title, and ETS: LTC John Mendenhall, 
fJ^rLf /'^ °^ Special Assistant for Information and Data Systems 
(SAIDS), indefinite ETS. The Data Processing Division is responsible to 
nim, 

3- Contact schedule and method: Contact by monthly visit or 
AUTOVON (483-2739). LTC Mendenhall effects changes in Le operations 
of Data Processing Division by DF (Form 335) , 

4 Additional information: When data clarification is needed, 
contact Mr . Gene Pugh, Data i-rocessing Division (AUTOVON 483-2635/2494) 
who is familiar with the details of Division operation. In Mr. Pugh's ' 
fpfo^t^o^ny?^"^'^ "^'^ Stanley Aldrich, Division Chief (AUTOVON 

Approximately 50, 000 IBM data cards are mailed from Ft. Wolters 
to HCC every two weeks by ILT Rodney Rawlings, LTC Mendenhall' s 
3SS is tBn t . 
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Section II: Fort Polk, Louisiana, Data 
A. Data: Training cards 1 and 2 (control cards). 

lo Agency: Trainee Administration, Coding Section. 

2. Responsible individual, title, and ETS: Mrs. Samudio, clerk, 
indefinite ETS. 

3. Contact schedule and method: Once a month via AUTOVON (733-1325, 
X-2621) , for data collection maintenance. 

4. Additional information: Mrs. Samudio mails the control cards 
every two weeks to PREDICT staff. 
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Section III: Hunter Army Airfield, Georgia, Data 

A. Data: 

1. WORWAC and.ORWAC Examination Grade Reports. 

2. Attritee Data. 

a* Agency: Office of the Registrar. 

b. Responsible individual, title, and ETS: Mrs. Maggie Hartnett, 
Civilian Supervisor, indefinite ETS. 

c. Contact schedule and method: Monthly, via AUTOVON (434-1520, 
X-5771/5512) , for data collection maintenance. 

d. Additional information: SFC Sewell, NCOIC, indefinite ETS, 
assembles attritee data for mailing. 
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B, Data: 

1, IBM academic and flight cards on WORWAC and ORWAC classes. 
2e IBM cards on Cobra classes when they are requested by us. 

a. Agency: Automatic Data Processing Division. 

b. Responsible individual, title, and ETS: Miss Lucy Waters, 
Computer Operator, indefinite ETS. 

c. Contact schedule and method: Monthly, via AUTOVON (434-1520, 
X-5027/5230) , for dafa collection maintenance. 

d. Additional information: Cards mailed to us upon graduation of 
the initial entry classes. 

Changes in ar I'angements to be made through Mr. James Morrison, 
Chief ot ADPS, AUTOVON 434--152n, X-5027/5230. 
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C. Data: Cobra School examination grade reports. 

1» Agency: Armed Helicopter Training School , (Cobra) . 

^^^f^^J^lf individual, title, and ETS: Mrs. Hopkins. Administrative 
Secretary, indefinite ETS. 

3. Contact schedule and method: Contact via AUTOVON A'^A-i520 X-5321 
as needed (no regular schedule). ' 

information: Mrs. Hopkins sends copies of Examination 
grade reports on the Cobra students upon request via AUTOVON. 
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Section IV: Fort Rucker, Alabama, Data 



A. Data: 

1. Letter orders (LOs) (Roster changes) 

2. Corrected Initial Phases II and III (ORWAC) and Phases III and 
IV (WORWAC) Rosters. 

a. Agency: Office of the RegibLiar. 

b. Responsible indivduals, titles and ETSs: Mrs. Nell Motley, 
X-2596, Statistical Clerk, indefinite ETS; Mrs. Gail Turner, X-2596, 
Chief of the Academic Records Branch, indefinite ETS. 

c. Contact schedule and method: 

(1) PREDICT staff visits Mrs. Motley every two weeks for data 
collection maintenance. Mrs. Motley sends the LOs through post 
distribution . 

(2) Every two weeks, PREDICT staff pick up, from Mrs. Turner, 
originals of class rosters, xerox them, and return the originals to her. 
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B, Data: 



1. IBM academic and flight grade car4s for WORWAC and ORWAC clashes. 

2. Examination grade reports (printouts). 

a. Agency: Automatic Data Processing Division. 

X 5291 ^TJT^^l^ individuals, titles, and ETSs: (Cards) Mr. Jimmy Walker 

Sui ivln x'5 9? 'nT"": '""if^'^^'^ E^S' reports) Mrs.. Sarlh ' 

auiiivan, X-:3<i93, Clerk, indefinite ETS. 

c. Contact schedule and method: IBM cards and printouts are 
delivered every two weeks by ADPS personnel to PREDICT staff 
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C« Data; Flight grade inserts (record sheets) from flight folders 
(includes Wolters and Rucker f ligrit grades) . 



1^ Agency: Department of Tactics, Supply. 

2. Responsible individual, title, and ETS : SP5 Pfau, Supply SGT, 
indefinite ETS. 

3. Contact schedule and method: SP5 Pfau phones PREDICT staff 
every two weeks when tht? flight folders of a graduated class are ready 

to be picked up, "Arrangements for changes should be made with SGT Butler, 
NCOIC, X-'3810/2782, 
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1. Form 20s 

2. Form 66s . 

a. Agency: Student Personnel Office. 

b. Responsible individual, title, and ETS: SGT Kiev X-6114 
NCOIC, indefinite ETS, » > 

c. Contact schedule and method: PKEDICT staff pick up students' 
Form 20s and 66s every two weeks, Kerox them, and return the originals 
to Student Personnel Office. 
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E. Data: Student folders. 

1„ Agencies: The four WOC companies at Ft. Rucker, Alabama. 
2. Responsible individuals, titles, and ETSs: 

a. 1st WOC, SGT W.A. Cobb, 1st SGT, X-4987, indefinite ETS. 

b. 2nd woe, SGT F.M. Fairchild, 1st SGT, X-4411, indefinite ETS. 

c. 3rd WOC, SGT F. Belcher, 1st SGT, X-6197, indefinite ETS. 

d. Ath WOC, SGT H.H. Spradlin, 1st SGT, X-2885, indefinite ETS. 

3., Contact schedule and method: Every two weeks on the class input 
schedule, PREDICT staff collect the folders of the graduated classes from 
the companies in which the classes were billeted. 
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Section V: Fort: Stewart, Georgia, Data 



A. Data: Flight grade inserts (record sheets) from flight folders 
(includes Wolrers and Hunter-Stewart flight grades). 

1. Agency: Department of Tactics. 

2. Responsible individual, title, and ETS : SGT Fields, NCOIC, 
indefinite ETS. 

3. Contact schedule and method: Once a month, data collection is 
maintained by AUTOVON 434-3600, X-2966/3 7 70. 

4. Additional information: For changes in arrangements, contact 
MAJ Sam Varney, DOT, AUTOVON 4?^-3600, X-2966/3770, 
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Appendix 3 

Per Cent Completeness of Manually Compiled Variables for 
Classes 69-05 Through 69-3U 



ORWAC 





Variable 


W0RV7AC 
Enl Op 
(iV=2l82) 


69-05 thru 
In Service 
(A/=765) 


69-29 
Total 
(/V=2 947) 


69-06 thru 

Total 
(/V=1396) 


1. 


Army Svc. No. 


85 


85 


85 


95 


2. 


Rank 


100 


100 


100 


100 


3. 


Age 


ICO 


100 


100 


100 


4. 


Mo. Act. Fed. Svc. 


100 


100 


100 


99 


5. 


Education 


100 


100 


100 


100 


6. 


Previous Fit. Trng. 


100 


100 


100 


94 


7. 


Procurement Source 


100 


100 


100 




8. 


FAST Composite Score 98 


93 


97 


29 


9. 


GT Score 


99 


98 


99 




10. 


Commission Code 










99 


11. 


No. Dependents 


100 


100 


100 


99 


12. 


AFQT Score 


81 


71 


79 




13. 


Marital Status 


95 


93 


95 


100 


14. 


Component 








100 


15. 


Branch 








96 


16. 


Quota Source 








100 
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Methods of Acquiring Data Not Available 
From Primary Sources 

The Military Personnel Records Jacket (201 File) is a secondary 
^source of demogrjiphic, biographic, and primary selection variables 
selected for inclusion in PREDICT I matrices. 

This appendix lists the pertinent documents normally found in 
students' 201 Files. Their titles are followed by "WOC" (Warrant 
Officer Candidate) and/or "OS" (Officer Student) to indicate which 
documents are pertinent to each. The document list is followed by 
a list of variables selected for inclusion in the initial matrices. 
After each variable is shown its location on the USAPHS Block Form (BF) , 
the current method of BF data entry, and a series of numbers, keyed to 
the document list, indicating which of the documents contain an entry 
for that variable > 

Key to 201 File Documents 

The following list is comprised of the secondary source documents 
which may provide demographic, biographic, and primary -selection data 
missing from primary sources- Individuals' 201 Files do not all contain 
the same documents. Therefore, it will be necessary to scan a given file 
for all documents listed in order to effect a complete search. 



1. 


DD 


Form 


4 - Enlistment Record/Enlistment Contract 

(If OS enlis 


WOC/OS 
ted as E 


2o 


DD 


Form 


20 - 


Enlisted Qualification Record 




woe 


3. 


DD 


Form 


Al - 


Record of Emergency Data 




^OC/OS 


4. 


DD 


Form 


47 - 


Record of Induction 




woe 


5, 


DA 


Form 


61 - 


Application for Appointment 




WOC/OS 


6. 


DA 


Form 


66 - 


Officer Qualification Record 




OS 


7. 


DA 


Form 


160 


- Application for Active Duty 




woe 


8, 


DD 


Form 


398 


- Statement; of Personal History 




WOC/OS 


9. 


DD 


Form 


507 


- Enlisted Personnel Data 




woe 


10, 


DA 


Form 


873 


- Certificate of "Clearance and/or 
Security Determination under EO 


10450 


WOC/OS 


11. 


DA 


Form 


1315 


- R.eenliS' 




woe 
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FAST Scoring Worksheets 



WOC/OS 



13, Active Duty Orders 



WOC/OS 



14. Application for Flight Training 



WOC/OS 



15. Flight Training Orders 



WOC/OS 



16. Promotion Orders 



WOC/OS 



17. Individual Training Progress Form 



woe 



List of 'PREDICT I Variables and 
Secondary Source Documents 



When demographic, biographic, or primary selection variables listed 
below are missing from primary sources, they usually may be found in the 
individuals' 201 Files on one or more of the DA or DD documents shown 
above whose marginal numbers follow each variable listed below. The 
document numbers appear in order of probability that the documents will 
contain the data soughL. 

If 201 Files are unavailable for use as secondary sources, their 
duplicates, the ^'TAG'* Files, are stored for (1) WOCs, at U.S. Army 
Personnel Services Support Center, Ft. Benjamin Harrison, Indiana; (2) 
OSs, at Off icer Personnel Records, TAGO, Falls Church, Virginia. These 
records storage centers fill requests for TAG File data. 

During the students* training tours at Ft. Wolters, Ft. Rucker, and 
Ft. Stewart-Hunter AAF, their 201 Files are stored in each post's Student 
Personnel Of^fice« At Ft. Wolters, the Chief of the Student Personnel 
Office is CW3 S.A. Porter, indefinite ETS, AUTOVON 483-3346/3347. At 
Ft. Rucker, it is 2LT John W. Haldeman, indefinite ETS, AUTOVON 899-1450 
X-6114, At Hunter AAF, it is MSG R.H. Jones% Personnel SGT, indefinite 
ETS, AUTOVON 434-1520/5804^ . 

1. Procurement Source . //33 on WOC BF, //62-64 on OS BF. Entered on 
BF by student at Ft. Wolters during the first week of student company 
activities. In 201 File; 1, 12, or on phonecon memo from The Aviation 
Warrant Officer Branch which clears the WOC for WOFT . "Quota Source" on 
BF (//65~67) also identified EO personnel. For OSs: 6 (item 18), 12, 5 
(item 10) , or 13. 

2o Rank . //28-29 on WOC BF, #28-29 on OS BF. Entered on BF by 
student. For WOCs: 2, 15, 14, or 16. For OSs: 6, 3, or 16. 

3. Age, #30-31 on WOC BF, #30-31 on OS BF. Entered on BF by student. 
For WOCs: 2, 3, 8, 14, 10, or 1. For OSs: 6, 3, 8, 10, or 5. 
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Branch. (appJicabie to OSs only") #3? - 3? on OS BF, Entered 
on BF by student. For OSs: 6, 3, and on all orders, 

5- i^5^2iiIlL.2lJ'li£^ ^^46 on WOC BF, //46 on OS BF- 

Entered on BF by sMidenr. For**"W0Cs: U or 8, For OSs: 6 (item 16), 
and In Flight Records Jacket of student- 

^ Harx^a] Stariys. ^^/.8 on WO^ BF, ^/67 on OS BF . Entered on BF by 
student:- For U'OCs: 2 or 3, For OS^: 6 or 3. 

7, Educa^ioi-» .i] level ^/^3 S'. on WOC BF, #53 - 5^ on OS BF. 
Enrered on B^S by .^M.dent. For WOCs: 2, 16, 8, or 4. For OSs: 6 (item 
16), or 8, 

^ M£2l^S_£ii£i_AiIl:iL£ • ^^"^"^ - -7 on WOC BF, ^'^^i - 57 on OS BF . 
Enrered on BF by student. For WOCs: 2 oc i, fl «hcws enlistment date 
and date discharged 1 t om enli&red acti^-e duty to attend WOFT, if man was 
IS when he applied, and also shows total AFHS.) For OSs: 6 or 5. 

9- ^!ii!!ilier_fLL:I^£^^^^^ ^'5^^ on WOC BF, #58 cn OS BF. Entered on 

BF by student-. i?^, wOCs: 2 or 1, For OSs: 6 or 3- 

^0- I^IlL^I^^' ''"^'^ ~ ^3 WOC BF, //70 - 75 on OS BF. Entered on 
BF by. Student Persmnel Otilce ixom any of the following: For WOCs: 2, 
.12, or 1^ For OSs: 6, 1?, 16. Jf FAST scores are not found in the 
student 701 File, ^hey may he obtained from the office of Dr, Harry Kaplan, 
U S. Anny Bebaviora! S:j.Gnce Research Laboratory, The Commonwealth Building/ 
13?0 Wilson Bon»].evaxdj ArUngron, Virginia, 22209 , AUTOVON 224-3705, 

AFQT S^orej>_ Cappl -rabip to WOCs only) #59 - 61 on WOC BF, 
Entered on BF by Student Peirsonnel Office from any of tbe following: 2, . 
1 , or . ' 

12. GT Scor es- (applicable to WOCs only) #62 - 64 on WOC BF. ' 
Entered by S^udent; Personnel Office from any of the following: 2, 1, 4, 
17, 1^4, 9, 11, or 

If a GT score it. noc found in the student ^s 201 File, he may be 
scheduled to r.<^.raVe the aCB funder the auspices of AG Testing) for 
derivation of (H' score. It is derived from the verbal and arithmetic 
subtests of the AFQT or ACB 

Ii:^.^^2i^Lf,£^».AL"ii^i^Hi.?^^^^ primaiy source, IBM Academic 

Cards, normally mrixled rcnm'Vt' WoUers ADPS to HumRRO HCC, should fail, 
tbe academic prin^-cMUs pioduced by ADPS specrfically £or PREDICT use 
serve as bark-up } m .individual evaminatlon grades. If PREDICT academic 
printouts should tail, tbe ..rrideorjc prinfourc. u^ed and stored by SRCB 
at Ft, Woi'-ers may be uir'^d. 
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14. Ft, Wolters Fllj^ht Grades , If the primary source, the IBM Flight 
Cards, normally mailed from Ft. Wolters ADPS to HumRRO HCC, should fail, 
the flight record printouts produced by ADPS for PREDICT use may be used 
as back-up. If both should fail, the (1) flight record printouts, or 
(2) daily flight grade slips inserted in the students' Flight Records 
Jacket may be used. Finally, flight records of Ft. Wolters students are 
microfilmed and stored by SRCB, providing another source of flight grade 
data, 

15., Ft. Rucker Flight Grades . Currently, the primary source, of 
Ft„ Rucker flight grades is the "flight record insert" which is a part • 
of the students^ Flight Records Jacket. If that should fail, the 
grades can be reproduced from the daily flight grade slips also kept in 
the Flight Records Jacket. There is no other source for Ft. Rucker. 
flight grades. 

16. Ft^ Rucker WORWAC Phase III,- ORWAC Phase II Academics . If /the 
primary source, duplicate IBM Academic Cards, normally mailed to HCC, 
should fail, the Examination Grade Report printouts produced by ADPS for 
PREDICT use may be used as back-up. Originals of the Academic Cards are 
.retained by iVDPS for two years. Additional duplicates are made upon 
request to Mr. J.L. Weeks, AUTOVON 899-1450, X-5293. The Registrar, 
Rotary Wing Quality Control, DOI, and Student Records also receive copies 
of Che academic printouts.- The Registrar's office keeps its copies for one 
year, then they are stored at Ft, Rucker' s Records Holding, .Department for two 
years, then stored at National Personnel Records Division, St, 'Louis, . 
Missouri, for, the remainder of 40 years from time of graduation. 

17. Hunter-Stewart WORWAC Phase III - ORWAC Phase II Academics . If 
the primary source, duplicate IBM Academic Cards, normally mailed to HCC 
fails, the Examination Grade Report printouts mailed to PREDICT staff 
from the Hunter Registrar's office may be used as back-up. Also, 
originals of the Academic Cards are retained by ADPS for two years. 
Duplicates are made upon request. 

18. Attritees Data . Attritee files are stored at SRCB at Ft. Wolters 
and the Registrars' offices at both Ft. Rucker and Hunter AAF. The 
pertinent data from these files "are reproduced for PREDICT use. They 
include the flight records. For those attritees on whom personnel data 
are still missing, inquiry is made of the U.S. Army Personnel Services 
Support Center, Ft. Benjamin Harrison, for the individuals' current 
military addresses. A letter of inquiry (see appended example) is sent 
to the CO of the unit to which each individual is attached, requesting 
specified 201 File data. 

Data are considered missing when the sources listed in this 
appendix fail to provide the information sought. 
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Appendix 5 
Piobabllity GxAphs ttid Tables 

FROM: 

TO: Distribution List 

SUBJECT: Prediction of student success in the initial entry rotary wing 
aviator training program 

Ir Pu tpose o To provide procedures for the prediction of success 

or failure for students in 0/WDRWAC c 

(Enter Course Number) 

2. Discuss ion o Training managers and student evaluation review 
boards often must decide whether individuals should be dropped from 
training, recycled to a later class for remedial training, or retained 

in training on schedule » An efficient training program demands that these 
decisions be as accurate and prompt as possible. Using aircraft and 
Instructors for the further training of men who are almost certain to fall 
to complete the program is a waste of time and money. However, dropping 
partially trained students who, with a little extra training, could 
become satisfactory pilots, is also wasteful. 

In the primary selection process, extensive quantitative infor- 
mation about student background and capability is complledo During 
training, quantitative information on performance accumulates rapidly. 
Training managers who have to decide about marginal students are faced 
by more performance data than they can absorb and Integrate into a 
decision in the time available o This sometimes results in failure to 
consider potentially valuable information- Accordingly, the Sest pre- 
dictors have been integrated by computer techniques and transformed into 
prediction tables and graphs to aid -ensuring the accuracy of managerial 
decisions concerning the retention" or attrition of students. Properly 
employed in conjunction with other criteria, these materials can help 
training managers and boards judge each case on its own merits and make 
recommendations to commanders concerning the disposition of the student. 

3 . Implementation . Procedures for obtaining the predictor score for 
individual students and interpreting that score in conjunction with the 
prediction tables and graphs are included as enclosure 1. 
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Graph-Tables of Predictor Scores 



The following graph'-tables provide a method for determining the 
probability that a student who is having difficulties will or will not 
complete the program. The procedures conform with the POI as of 

. . The probabilities given in the tables are 

actually the success/failure reco)rd8 of classes 

through ^ for WORWACs and 

through for ORWACs. To compare a current student 

V7ith these records, take the following steps: 

lo Find the appropriate table. There are separate tables for 
officers, in-service WOCs, and enlistment option WOCs. There are also 
separate tables for various stages of training. For example, if you 
were considering the case of an in-service WOC student who is in 
difficulty after he has completed five graded flights but who has not 
yet .soloed, you would turn to the table entitled IN-SERVICE WOCS— AFTER 
5 GRADED FLIGHTS, 

2. Look up the information required in the instructions at the 
top of the graph table. This will differ from table to table. 

3., Call the Student Prediction Center, Extension . 

Give them the student's name, his class and roster number, his point in 
training, the information specified in the table, and your phone number. 

(In the case of the student above, you will give his score on AME ^ 

WDE , and his last three flight grades.) 

4. Within about fifteen minutes, the Prediction Center will 
telephone you and give you the prediction score for that student. 

5. Compare this score with the data entered in the graph-table. 
Suppose, for instance, thAt his predictor score is 36. In the summary 
table you can see that this score falls into the 35-38 bracket, and 
that scores made by three per cent of the students fell below this 
bracketo Since thf^^^ -gtudent 's score is near the lower limit of this 
bracket, you can safely say that he compares to the bottom 10 per cent 

of students from classes through who reached 

this point in training. The summary table shows that for the 35-38 
group as a whole, 45 per cent graduated. Of course, the 35-38 group is 
a below average one, for on an overall basis, 61 per cent of students 
who reached this point in training graduated. Looking at the point on 
the graph which corresponds to a score of 36, you can see that about 

40 per cent of men with this score graduated, or that the odds are about 
3 to 2 against the man. Said another way, of every five tnen who had 
Such scores in the past, three did not complete training. 



Inclosure 1 
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